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Patterson AFB, Ohio: Advanced Systems Division, Air Force Human Resources 
Laboratory, February 1974. 
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SECTION I 



Introduction 



Instructional System Development (ISD) , as defined in the Air Force 
Manual 50-2 of the same name (Department of the Air Force, 1970) is "a 
deliberate and orderly process for planning and developing instructional 
programs which Insure that personnel are taught the knowledges, skills, 
and attitudes essential for successful job performance," The following 
a list of brief descriptions of the major ISD activities, 

(1) Determine Job Performance Requirements (JPRs ) . The 
process of determining the tasks required of the 
human component, and the standard of performance. 
This process applies to all types of "Jobs/' It 
results in a statement of all human activities 
(skills, knowledges, and attitudes) required for 
successful performance. 

(2) De termine Training Requirements (TR s). The pro- 
cess of deternining the changes needed in skills, 
knowledges, and attitudes of personnel, so they 
can perform a job. These changes, when added to 
the entering repertoire of abilities, must meet 
the JPRs. 

(3) Determine Criterion Objectives . The process of 
specifying the objectives which the student must 
meet to satisfy the TRs. Criterion objectives 
specify precisely what behavior is to be exalb- 
ited, the conditions under which behavior will be 
accomplished, and the minimum standard of accept- 
able performance* 

(4) Develop Criterion-Referenced Tests . The process 
of developing and administering tests which 
directly measure the criterion objectives. The 
survey test is administered to samples of pro- 
spective students. The purpose Is to verify 
which skills and knowledges to Include in the 
course of instruction. Criterion-referenced 
tests (course criterion tests and diagnostic 
tests) are also developed to determine if the 
br.haviors in the criterion objectives have been 
acquired. 

(5) S elect Medi a /Methods . The process of selecting 
appropriate media and methods for each block of 
instructional objectives. Selection is based on: 

(a) Pract^-1 constraints (such as financial 
consl^rations) 



(b) Instructional nature of the objectives 
(certain behaviors may be Important In 
training, but not on the Job) 

(c) Presentation mode implied by the objec- 
tives (visual, auditory, etc) 

(d) Type of learning Involved (for example, 
simple visual discriniination; chain of 
skilled performances) 

(e) Best instructional sequence for the 
objectives 

(6) Develop Instructional Materials > The process of 
developing and integrating the actual materials 
which make up the instructional regimen, 

(7) Validate and Revise Instructional Materials . The 
process by which each unit of instruction is tested 
(validated) as it is developed. This process 
Insures that criterion objectives are satisfied. 
First, materials are tested on several individuals 
and revised as necessary* Then, they are tried out 
on small groups of students, carefully sampled from 
the potential student population. Final revisions 
are made. 

(8) Conduct Instructional Program . The process of imple- 
menting and administering the instructional program. 
This Includes training of Instructors and scheduling 
as well as the actual conduct of the program. 

(9) Evaluate Instructional Program . The process of 
determining the extent to which graduates of the 
instructional program satisfy the performance 
requirements in the Job environment. Detailed 
records of graduate performance are kept, and 
changes to the instructional program are recom- 
mended as necessary. 

The technology of ISD has advanced significantly since 1950. A large 
body of literature relating to all aspects of the developmental process 
has emerged in the past 20 years. However, only for selected purposes, 
and then not comprehensively, has the literature been synthesized for use 
by practitioners. With the information explosion, it is virtually impos- 
sible for users to assimilate what has been accomplished in the past, much 
less to keep up with the technology. Hence, the need for a technical data 
file that permits synthesis of the information relevant to ISD. 

The technical data file has been designed to satisfy the needs of Air 
Force users. Instructors and other personnel of all Commands who have 
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responsibility for course development will be the primary and typical users. 
Air Force Research personnel who are investigating methods for improving the 
instructional development and implementation processes will also use the 
file. 

This handbook presents guidelines for abstx'acting the technical liter- 
ature relevant to ISD. These guidelines > although specif ic€.lly developed 
to apply to that abstracting necessary for the creation of a technical data 
file on ISD, are general enough to apply in many situations where abstracts 
of technical literature are desired* 
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SECTION II 



Types of Literature and Types of Abstracts 



Types of Literature 

Literature pertaining to ISD has been divided Into two general 
categories according to the type of abstract that is used to summarize 
documents within those categories. The first category of literature 
consists of documents that are summarized descriptively (Type I Abstract), 
while the second category includes documents that are summarized infor- 
matively (Type II Abstract). Of course, to be Included in either 
category, a document must concern one or more of the steps (e.g., 
determine instructional objectives) in ISD. 

The first category includes opinion articles, methodological 
developments, evaluative summaries, literature reviews, and bibliog- 
raphies. The second category includes statistical sampling studies, 
correlational research, and research studies in which variables are 
manipulated. The following Is a list of brief definitions for each 
type of document: 

1. Opinion Articles ; Documents that present the 
author's educated opinion or untested theorizing. 

2. Methodoloj^ical Development Articles : Technical 
reports, technical notes, guidelines, and procedural 
notes concerning the modification of ISD-related 
methodology. Developments reported in this type 

of document may have been tried in a systematic 
fashion, based on prior research results, or may 
simply be suggestions. 

3.. Evaluative Summaries ; D'^'cuments that summarize 

the knowledRe in a specific subject area and that also 
present critical commentaries on the state-^of-the-art 
for that subject. 

4. Literature Reviews : Documents that present summaries 
of specific literature within a subject area and 
which do not necessarily include critiques of that 
literature (but often do). 

5. Bibliographies : Bibliographies and annotated 
bibliographies of the literature in a specific 
subject area, presented as a separate document. 

6. Statistical Sampling Studies : These documents 
include reports of survey, questionnaire, and inter-* 
view studies in which the techniques of statistical 

Q sampling have been applied. 
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7. Correlational Research : Documents that report 

correspondence among variables based on correlation 
coefficients ♦ 

8- Research Studies In which Variables Are Manipulated ; 
Documents that report research studies In which the 
researches manipulated Independent variables and 
recorded associated changes In the dependent variables* 



Types of Abstracts 

Two general types of abstracts ulll be prepared depending on the 
nature of the document being summarized* 

Type I Abstract * Type 1 abstracts are prepared for opinion 
articles > n^thodologlcal development articles, evaluative summaries , 
literature reviews, and bibliographies* Type I abstracts do not 
take the place of the document but summarize the contents sufficiently 
that a user of the technical data file can determine whether the 
original document would be appropriate for his needs* The inter- 
relationships among topics and their relative emphases ate noted. 
Within the confines of reasonable space limitations, items in the 
document which are of particular relevance for the instructional 
system designer (e.g., a short procedure for evaluating the effective- 
ness of CAl) are also noted. 

Type I abstracts also include an evaluation of the documents' 
clarity, readability, and its unique contributions to the ISD process. 

Type II Abstract * Type II abstracts are prepared for statistical 
sampling studies, correlational research, and research studies that 
manipulate variables. Type II abstracts are sufficiently detailed 
that a user of the technical data file need not go back to the original 
document unless he has a very detailed requirement such as actually 
replicating the research that was reported. Type 11 abstracts summarize 
(a) the problem posed by the investigation, (b) the method, (c) the 
results, and (d) the discussion/conclusions sections of the document. 

The fifth major section of a Type II abstract is an evaluation* 
which includes a consideration of the validity, overall clarity, and 
appropriateness of the research design; a substantiation of the 
conclusions; and a statement about the relevance of the work for ISD. 



*The statistical and design criteria for evaluating articles are based 
on those established by Campbell and Stanley (1966)* 
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SECTION III 



The Abstract Form 



Examples of a completed Type I and Type II abstract are appended to 
this report as Appendixes I and II, respectively • Poth types of abstract 
are prepared on the same general form. Portions of the form are appro- 
priate to every abstract. Other parts are relevant only to particular 
documents with specific characteristics • On Pages 9 through H, a 
blank Abstract Form Is presented In which each of the major subsections 
Is numbered. In the following paragraphs the numbered subsections are 
discussed. 

Page 1 of Abstract Form 

1. Sequence Number . The sequence number Is assigned 
to identify the order of document acquisition. 

2. Abstract Type * The abstractor checks off whether 
a Type I or a Type II abstract Is being prepared. 

3. Reference Information . This section Is filled in 
by the typist based on the bibliographic reference 
cited by the abstractor on Page 2 of the Abstract 

. Form* 

4. General Search Terms . The general search terms are 
assigned by the abstractor after reviewing the 
article. These words will form the primary means 
of search for the abstracts. A large subset of the 
possible search terras is presented in Appendix IV, 
The Directory of General Search Terms. This direc- 
tory will help abstractors use standardized 
terminology. 

5. Unique Search Terms . Unique search terms, assigned 
by the abstractors, are words which are unique to 
the specific document. For example, they may be 
descriptions of major systems Involved, trade names 
for particular types of media used or treated, new 
terms discussed at length in the document, or the 
names of authors dicussed in detail In the article. 

6. Suggestions for Additional Research . Often the 
authors of documents will mention suggestions or 
Implications for future research. These suggestions 
or implications are summarized by the abstractor 

as succinctly as possible. 
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7. Cross Reference , This section of the Abstract 

Form is filled out at a later date* It references 
the sequence numbers of closely related documents. 



Page 2 of Abstract Form 

8. Sequence Number . Same as number 1. 

9. Bibl io graphic Reference , The bibliographic reference 
is cited by the abstractor. The American Psychological 
Association (APA) Publication Manual provides the 
standard formats for citations. Excerpts from the 
1967 edition of this manual detailing the mechanics 

of citing references are included as Appendix III of 
this handbook. 

10. Body of Abstract . The body of the abstract is 
prepared according to the guidelines in this handbook. 
It consists of a condensation of the document content. 

11. Evaluation of Document . The evaluation is prepared 
according to the guidelines in this handbook. 

12. Number of Pages > Number of References > Initials of 
Abstractor . These items, filled in by the abstractor, 
are self-explanatory. 



P age 3 of Abstract Form 

13. Sequence Number . Same as number 1* 

14. Summary and Evaluation Form . The third page of the 
Abstract Form serves a four-fold purpose. First, 
the abstractor can use it as a convenient tool for 
summarizing a document by filling out the form while 
reading the article. The process of completing the 
form will furnish the abstractor with most of the 
information necessary to prepare a Type I or Type II 
abstract. Secondly, filling out the Evaluation 
Checklists portion of the form will provide the 
abstractor with a handy summary for writing the 
evaluation portion of the abstract. Thirdly, the 
form will furnish a handy capsule of the type of 
document, topics discussed, types end methods of 
research employed or discussed, and media and 
approaches to training discussed so that a user of 
the technical data file can assess in a glance the 
suitability of a document for his needs. Finally, 
the most important characteristics of the document 
are synthesized in one place, thus facilitating the 
computerization of the technical data file. 
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affKit of uncoAtrollad, ■■ ironoua vo«ijfelat. 
I>. TM vlfKia of ln<}«pa(%daAt«tfiobiH a«a not <0fifei4nd«d w^ff* t>ta 

alfKia of mol^BrlO<^«l arlabiaa. 
II. CoAttOl groupt w^a opp^epf^at* rof c.»n\po/iton with iRp«flrr»«nui 

IS. lnaap«ndw>UtrM(*« iri adoduiialii «p«ci(«d, (Qwai1latkal«) 
JO. OopondoAi «iri«6l«a Ira adoquiiam tpoclhad. l<^iiit«tKraN) 
II. Variabiaa bra oporaitonoiiv dalJnad. tQua^illitiva, f«fs«raiiy] 

Approprtiu tnMMrn a«i t«rKl«4 for dapOfldtni «arM>l««. 
n, Ciparimonrar m«A»pwfsfa« t^htt ha aayi h* maAipw^fao, 
3*. Co<Ndillon» undor ttrftkh aiparimoni mm condwclad a<o ctoarty ipoctfiad 

•ntf d«<in«alad in tuHkiooi drtaii. 
^ Pataa^h <t«$i«n lafrM of oihar ipoctfk waaimOMOt. 
M. Oal«-4otf^*rlrtf «rtat>todt o« p^oeadurw o>i davcrtbod In «u(fi<lant data^l 

to all«« rop(ka»ion. 
17. 0•t•->t^arJr^« mattvodt O* pfpcaduro* IoKom IrOOt itio rOtaafcK dO»i»n, 

matKodt Or procadurat v apvbf>«lm to t^a loKtlrOf^ o< iha p^oblom. 
91. Ort»-|ot>i«rlnf m«if«odt o< Procaduro* do nni i^trodwca aftifactual bittoa 

Into drU. 

24, RotOvchor Km t»k an ipp^opriota i<«p4 to oliff«i«v«ia Of control lof 
aipbrlmoniar bita and »»if fulf inirt« pfop>>ocy. 

Rttulll: 

30l Ott*-aaihorlftf <Tk«thoda 6« pfo(*du>aa «ra u«ad corracily. 

) I . M i<iab<1>l y of moMurir>« hMtrwrton tt H att«bMrf^ad. 

)!. VgUiHr of moaawrw^ tr>ain*rr>«Aa It Hl«bl>l^ad. 

11 ApfKoprtait ntatyvodi *f« aaiactad to a/^alyta tM o«to In ac<ocdar,ea 

wrfth tf>o«o SPkdkrtad by tfta roaoarcri dat}«n. 
A4. M«tKodt iitod to anaiyaa tf^a data af a uMd cotactly. 
3Sk ftatuiM o* iKo a<^«ryt•« trt pfOMntod cloorly. 
M. Graphs aMttbMarvp'oaontadcfaorfy. 
17. ^ly liyitf ic4nl r*twili ort Inirod^Kad M moantr^flfui data. 
M. Conl<dar^a lovalt ara tt»iad eiao^y fend it uAututt. Kittlfiod. 
IB. Unulual avatiatkal P<oeodwr0« »f ur^iawal apptkotiona of ttondard 

pfOcadviraa ora datcribad eWty a«^ |a-'l^f«*d. 

40. tran«fpfm*d data vo claorfy ipoe^iad aa twcA ortd <nat^odt cprn-araJon 
afo ttotad cioo'ty ond adoquatoly Kiatrflod. 

41. C«n<lutlorHara autad ei««rly. 

42. C«nciwalo#4 1» ak«bai^i laiod by i^* bvManca praaaniad. 
Gonortflxtt^OAt ara coftfirvod to tfta populttloA from wfikfi tfwi toMpia 
«raa ^awrfv 

44, Conckjt^ona raiata on?y to tha para'nr.ari of «ha ^oat^^ tt^at 
wr«ra ipoclfiod undor OJiporbndnUl coAditiont. 
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IIOUCMSff NO. 



4a. Infaronttol fend inta^pfothro e«^clualO«« art c>««rly ^<fl«d at «>ctk 

4ft. Infarortlaitnd lntarpr«lv»c«^clw>ip(MaraV»t)fiod. 

49. •p4Cw4«tlo«it ^•waa, and tMdHilniara p>otpft«a(^tad aaconciwtiona 

^^^^.^ thot foitew from iM dola. 

I I I I J 44. f>ttplkotfor>a fOf futwr«r«<»o«Yh or* lOfkaDy fof«vwUtad. 

Oirity ind UMtulntii^ 

41. flapofi 1| MrrStlon cla«rly. 
M. Maport It Ip^aMy br|onlta<,' 

•I. Rapon It rooacnably oaay to Collcw a'Nd It npi contuiJrv^ 
**• Tofva ol iM ropo<t diip'ayt an unbroaod. irrvponiai acltntif k attltudtk 
U. Raporl ia ol «»od oworall quollty. 
*4. Ropon (a of trnportonco le !»♦« pf oblorrt aroc 



14A 



Z DOCUMENT X TOPIC 
PROFILE 



mUtm 



1 


OatOrmln* io« («f ActMly^ 
Porlormonca Maqs^lromanu 




















2 


Dottfmsna Cdu«4tlon of 
Trolntnfl A aqu1<«rhanti 




















% 


0«torrn)n« lnatn>ctfonol 
OtoloctUaa 




















% 


Owioiop Taaia 




















4 


loJact Modlomvihpdt 




















4 


OotrOlop Inrl^ctlon^ 
M«tar1«lf 




















4 


VaitdaTa and f^*r(io 
InatTMtionol Matortala 




















4 


Cervduct InatruciSo'va) 
^e#ram 




















5 


Cvaiuata lnaiiucir«<-af 

P'OJ»»n 




















tpocify; 





















3. MEDIA/INSTRUCTIONAL METHODS DISCUSSED 
3A. COMMUNICATION MEOIA 3E, VISUAL AIDS 

Avd«o: 

□ Radio 

□ rapa Racordaf 

□ Rocord Piaya^ 

□ LHtoninf Lab 
Vtiual; 

□ rilmiirip (Sitantl 

QMotion Ptctwra atRapttiiKo LoopdiUnO 

□ TaAibooh 

□ Mtcrolorm 
Aud^OvlOuat: 

□ ^nd/Siida Projaeior 

□ ^tlrr>ttrip/(eund 

□ TaioviiaoA 

□ Motion Pictura 

□ Mortort fictwt aa 
Aapailii^a Loop 

38. ENVIRONMENTAL MEDIA/AfOS 

□ limulaior 

□ Wfiol»r*tfe Trainar 

□ Prpcadurat TrOinM 

□ Carrvat 

□ Rola P^y 
O tpClPdrirTva 

□ OpOfaiiOAol C4vi>pm«nt 

X. TUTORIAL MEDIA 
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Oriphkt' 

□ Cha/ta 

□ OUrann 

□ Grap#»t 

□ inuatrit'P'^t/ 
OawlrtBi 

O Pttotofrap^a 

c»^(bitt' 

8CwtA-Mtya 
Mocktjpa 

□ Modaia 
^rolactad Ima^aa 

a Opaqua 
^roiotiiona 

□ OvOrlvoad 
Traniporafkioa 

□ Slid** 

3F. METHODS OF INSTRUCTION 

□ TulPrlol 

SLOclura 
ffocitaiion 

□ DiKuiaion 

□ 0«nM4Htrailp«i 

□ t«rTWltt»PA 

Qfaor Trd^jn^ 

□ room Train lAg 



□ CAt/CMI 

□ frearartimod f««f 

□ T«acKtn« MachtnOt 

□ Loarnlni Lab 



30. OTHfR: SPECIFY 



30. MULTIMEDIA 



TYPES AND METHODS OF RESEARCH EMPLOYED 
{FOR TVPC II DOCUMENTS ONLY) 
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4A. TYPE OF RESEARCH 

□ iMk 

□ Lab fttudv 

□ Appllad 



4B, METHOD OF RESEARCH 

□ Hltiwkal 
O Dotcrlpilva 
OCm»^ />*(d 

□ 0*vat«pm«ntal 

Q C«jtal Co<r>p4^''*« 
Of "ti Pott Paeto** 

□ CoiTolational 

□ ffva C«p«ri/n««viM 

□ Owaaltiporlmoniot 
a A<lSOA 

□ Od>or. tpacily . , , 
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The Evaluation Clieckllsts are completed as per 

the attached Instructions. The ISD topics covered 
In the report are checked off In the column (s) 
corresponding to the type of document being reviewed 
(14-b) . Next, the boxes beside all media and 
methods discussed In the article are blacked In 
(14-c) . Finally, for Type II documents, types and 
methods of research employed are marked (l4-d). 
Table 1 on Page 13 describes the nine basic methods 
of research listed under Method of Research (14-d) 
on the Summary and Evaluation Form (Isaac and 
lilchael, 1971). 
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SECTION IV 



Abstracting Guidelines 



These guidelines are a modification of those developed by Payne, 
Hunger, and Altman (1962). Portions of the guidelines set In quotes 
come directly from that docjment* The format employed here is based 
upon their format and a number of steps have been paraphrased from 
their materials* 



General Instructions for Abstractors 

1. Using the APA Publication Manual, enter an accurate bibliographic 
reference on the second page of the Abstract Form and then read 
through the article to be abstracted in its entirety. Before 
you begin abstracting, be certain that you fully understand the 
contents of the document. If the article appears too difficult 
for you, do not attempt to abstract it . 

If the article calls for a Type I abstract, look for innovative 
techniques that would help an instructional system designer. If the 
article calls for a Type II abstract, pay particular attention to 
the methodology, results, and discussion/ conclusions sections. 

2. Complete all four sections of the Summary and Evaluation Form 
(Page 3 of the Abstract Form) during or after reading the document 
but before writing the abstract . 

3. Use short, complete sentences. Make sure your meaning is absolutely 
clear. Avoid the use of compound sentences when possible. For 
ease of reading by typical users, you should Insure that your 
materials receive an average fog count of about 20 (Department of 
the Air Force, 1969) . 

4. Present data and techniques accurately. In Type II abstracts 
present results and other data accurately, without distortion. 
Likewise, when citing particular techniques in Type I abstracts, 
be sure the summarization is appropriate. A bstracted data and 
techniques must be double checked aRalnst the orlelnal article to 
insure accuracy . 

5. Both Type I and Type II abstracts may be of any length necessat^ to 
adequately cover a document, but they should be as concise as 
possible. In the Interests of brevity, do not present material 
which is (a) common knowledge to practitioners in the field, or 

(b) redundant to other material Included in the abstract. 

6. Define any technical words or phrases which are new to you and/or 
not currently listed in the Directory of General Search Terms 
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(Appendix IV) • These may be listed on a separate sheet of paper 
and attached to the abstract » unless their definition Is required 
for understanding the abstract. 

7, Use only abbreviations and symbols that are knovm to be standard, 

8, For documents requiring Type II abstracts that consist of a series 
of experiments ^hlch are related and Interdependent (such as a 
research monograph) more than one abstract may be needed. "A sumary 
abstract should be prepared which covers the basic findings and 
conclusions of the series," If detailed descriptions of methodology, 
results, and discussion/conclusions are not possible in the summary 
abstract, prepare separate abstracts for the individual experiments. 

9, A document is evaluated with the help of the checklist (on the 
Summary and Evaluation Form) that was completed prior to writing 
the abstract. 

10. While reading the document, note the location in the document of 
all suggestions for additional research. After you have completed 
the abstract, synthesize these suggestions for additional research 
and list them In the appropriate place on the first page of the 
Abstract Form. 

11. While reading the document, make notes of all General and Unique 
Search Terms. After you have completed the abstract, check again 
for additional search terms. Then alphabetically list all pertinent 
terms in their respective sections on the first page of the Abstract 
Form. 



Detailed Abstracting Guidelines; Step-By-Step Procedures 

The Instructions are composed of ten separate steps* For certain 
types of articles some of the steps are bypassed as noted in all 
capital letters. These instructions should be followed explicitly* 

STEP 1. Prepare a standard bibliographic reference on Page 2 of the 
abstract blank. Use the form and order recommended by the 
APA Publication Manual attached as Appendix III. Abstractors 
should become completely familiar with the APA style for 
citing bibliographic information, including such details 
as punctuation, underlining, etc > A major exception is that 
items normally underlined in the reference are placed in 
quotation marks for ease of couputer search. The general 
order and form are presented below: 

A. Author (s) "Give names of all authors. Use inverted 

order, the surname first, followed by the 
initial or initials." 

B. Title Use the full title, capitalizing only the 

first word of the title, unless there is 
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C. Publication 
Information 



a colon, In which case the word following 
the colon Is also capitalized. Titles of 
articles, monographs, and most reports 
are not underlined or placed in quotes. 
Titles of booktt are placed in quotes. 

Book Cite city (and state, if the 

city is obscure or there are 
several cities of the same 
name) of publication followed 
by a colon, publisher's name, 
and year of publication. Cite 
page numbers if document to 
be abstracted is a section of 
the book. 

Periodical Cite full periodical name and 
place it in quotes. Cite year 
of publication. Cite volume 
number and place it in quotes # 
Cite Issue number and place it 
in parentheses. Cito inclusive 
page numbers of article to be 
abstracted. 

Government "No simple rules can be given. 

Report Give sufficient information so 

that identification is possible ." 
For example, report document 
numbers, contractors' names, 
and publication dates. 

NOTE: Specify the nature of the publication 
(book, periodical, government report), 
if it is not obvious from the previous 
reference information* 



D. Library 

Acquisition 
Numbers 



For a document that is catalogued in a major 
information center (e»g., ERIC or DDC) provide 
the acquisition number in parentheses at the 
end of the reference. 



STEP 2. 



Complete the Summary and Evaluation Form on Page 3 of the Abstract 
Form. You should fill out Part 1, Evaluative Checklists, as you 
read the document. Parts 2, 3, and 4 may be filled out during 
or after reading the article but before preparing the body of the 
abstract. 



A. Evaluative 
Checklists 



Choose the correct evaluative checklist (Type 
I or Type II) and fill it out according to 
the attached instructions while you are read- 
ing the document . For items which are not 
fully satisfied by the document, be sure to^ 
make a note of the defect on a separate sheet 
of paper. For convenience in the preparation 



ERIC 



of the evaluation, number your notes to 
correspond with the Items, Only one checklist 
Is filled out for each document. 



B. 



C. 



D. 



Document X 
Topic Profile 



Media and 
Instructional 
Methods 
Discussed In 
Article 



Types and 
Methods of 
Research 

(TYPE II 

ABSTRACTS 

ONLY) 



Do not check cells tf an ISD topic Is simply 
mentioned In a document. Check a cell only 
if the associated topic is discussed substan- 
tially or is a focus of the document. A 
document may pertain significantly to one> 
several, or all topico. Check all relevant 
categories (cells). Also, a document may 
be of more thaii o;^e type (e.g., both an 
evaluative sutniary and an annotated bibliog- 
raphy) in which C8S6 all the associated cells 
should be checked. Widi the added insight 
gained from preparing the abstract, addi- 
tions or deletions may be made. 

Black in the box^s for media and instruc- 
tional methods that are treated substantially 
in a Type 1 document. For Type II abstracts, 
indicate media/methods that are Important 
parts of statistical sampling studies, 
correlational research, or research studies 
that manipulate variables whether or not 
they are discussed at length . With the 
added insight gained from preparing the 
abstract, additions or deletions may be 
made. 

(FOR TYPE I ABSTRACTS, GO TO STEP 3) 

For Type II abstracts, indicate the appro- 
priate types and methods of research that 
were used by the author(s). It is 
recommended that the initial indication be 
made while reading the document, then, 
after writing the abstract, any additional 
items that were missed the first time should 
be marked. Methods of research are described 
in Table 1, Page 12. 



STEP 3. 



(FOR TYPE II ABSTRACTS, SKIP TO STEP 4) 
(TYPE I ABSTRACTS ONLY . TYPE II ABSTRACTS: GO TO STEP 4) 



This section comprises the body of the Type I abstract, 
contents of the document are summarized in this section. 



The 



A. Summarize 
Contents 
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^^Indlcate the subject matter as clearly and 
concisely as possible." This section should 
be like a concisely annotated table of 
contents. For example, if the author 
Includes headings and subheadings, list 
these with a brief description of what is 
included under each heading or subheading. 
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B, Innovations Describe any innovative applications or 

and Conclusions concepts which might be useful for ISD. If 
the author draws any substantive conclusions 
applicable to ISD, describe these. 

(GO TO STEP 7) 

STEP 4. (THIS STEP AND STEPS 5 & 6 ARE APPLICABLE TO TYPE II ABSTRACTS 
ONLY) 

"State the problem and describe its utility as accurately and 
concisely as possible.'* Information included In this section 
must be adequate for understanding the discussion/conclusions 
section* 



A. General 

Statement of 
Problem 



B. Applicability 
of the Study 



"Problem statement should be brief. If the 
author has offered an hypothesis, this should 
be explicitly stated and identified as such. 
If the author has not presented an hypothesis, 
derive an hypothesis-like statement indicat- 
inR origin by the abstractor . In either 
case, this statement must present information 
which defines what the article investigates *^^ 

Give the specific applicability of the study 
and the reasons for the investigation. What 
is the import of the workj how does the 
author justify the research? 



STEP 5. (APPLICABLE TO TYPE II ABSTRACTS ONLY) 

Describe the method of Investigation so that the results can be 
evaluated adequately. "Study conditions must be presented in a 
logical manner, so that there is consistent progression and no 
redundancy. The following indications of study conditions should 
be included." 



A. Subjects (1) Describe characteristics of population 

including size, location, age or grade ^ 
level, and other specific characteristics. 

(2) Identify sampling procedures. 

(3) Describe characteristics of sample as 
in A(l) above. 



NOTE: A(l) through A(3) may be stated briefly^ 
for examples ''The Sa were 220 intro- 
ductory psychology students at Midwestern 
University, who served in partial ful- 
fillment of a course requirement; Ss 
were naive with respect to the experi- 
mental material*" 
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B« Experimental 
Design I 
Variables, 
& Statistical 
Treatment 



Ct Apparatus 

and Materials 



D, Procedure and 
Procedural 
Cont rols 



(1) "Specify the Investigative methodCs) used 
in approaching the problem. Describe or 
outline the research design. Traditional i 
orthodox designs can be referred to In 
common terms and need only a brief 
description* New or unique designs 
should be clearly described in terms of 
their essential features." 

(2) Identify the Independent and dependent 
variables quantitatively and/or qualita- 
tively. 

(3) If measures were taken, indicate the units 
of measurement used and method of data 
analysis. Traditional, orthodox methods 
of data analysis can be referred to in 
common terms and need only a brief descrip- 
tion. Indicate how the research design 

in B(2) above calls for the particular 
type of data analysis that is used. 
Specify statistical controls that were 
imposed on the investigation, e.g., 
counterbalancing, covariates, etc. 

(1) Give descriptions and specifications of 
equipment and apparatus if relevant to 
the study conditions. Likewise, describe 
all teaching methods, aids, media, and 
Instructional devices employed. 

(2) "Indicate what was examined." Indicate 
subject matter or performance taught 

as appropriate. 

(1) Present sufficient detail so that the 
procedural approach can be fully under- 
stood. However, do not present all the 
detail necessary for replicating the 
research. If the user of the technical 
data file needed to replicate an investi- 
gation, he would have to consult the 
original document anyway. 

(2) Indicate what procedural controls were 
Imposed on the investigation. For 
example, were special instructions given 
Ss in order to control for motivational 
effects; were instructions presented by 
tape recorder to help prevent experi- 
menter bias, etc. 
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E. Unusual (1) Transformed data— "When data have been 

Sources of manipulated In any way prior to data 

Data analysis, present sufficient Information 

to enable the user to follow the manip- 
ulation. Standard data handling tech- 
niques need not be described In the same 
detail as variations or novel techniques.'' 

(2) Non-orlglnal data — If not obvious from 
the preceding parts of the abstract, 
Indicate whether the author reported 
data generated by himself or by others. 

NOTE: The material covered In Step 5 above Is reviewed In greater speci- 
ficity In items 10 through 29 on the Evaluation Checklist for Type 
II Abstracts. (See the Summary and Evaluation Form.) 

STEP 6. (APPLICABLE TO TYPE II ABSTRACTS ONLY) 

Present the major results and Identify the conclusions asso- 
ciated with them. 



A. Results and 
Direct 
Conclusions 



Results should be presented In such detail 
that conclusions are obvl State direct 

conclusions. Direct co.icJvi^lons must relate 
only to parameters of the Investigation pre- 
viously specified. Conclusions presented 
must be preceded by sufficient data to justify 
the conclusions. 



B. Indirect 
Conclusions 



When results arc essentially answers to spe- 
cific problems, present data in sufficient 
detail to justify the problem solution. Indi- 
cate level of significance. 

Place brackets around the sentence or sen- 
tences relating to direct conclusions which 
indicate the relationship between the inde- 
pendent and dependent variables. These state- 
ments will be typed in all caps with asterisks 
(**) surrounding them. 

"state Indirect conclusions. Indirect con- 
clusions may relate to secondary or peripheral 
.areas of investigation, inferences, and inter- 
pretations made by the author. Present the 
data which led to these conclusions, infer- 
ences , and interpretations . " Loose theoretical 
linkages and speculative questions should b e 
excluded. ~ 



STEP 7. Evaluate the document in the space provided on Page 2 of the 
Abstract Form, 
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A. Evaluation As noted in Step 2A, the evaluation checklists 

Checklists (either for Type I or Type II abstracts) 
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should be filled out while the article is 
being read. Notes of defects, keyed to the 
25 items (54 items for Type II) have already 
been made. All that remains is to summarize 
the defects in the evaluation section of the 
Abstract Form, using complete sentences « 

In addition to commenting on the defects in 
the document, you should write a brief 
sunnnary statement to complete the evaluation. 
The summary should indicate the overall 
quality and importance for ISD of the docu- 
ment* For example, if an article fully 
satisfied almost all of the applicable 
checklist items (i.e., almost all items 
were rated 1) , the abstractor would make 
a special note of the high quality of 
that article. 

STEP 8. Identify the suggestions for additional research put forth in 
the document. The recommended procedure is to note where the 
author makes suggestions for additional research in the text 
of the document. Then an overall assessment of these sugges- 
tions should be made. Loose theoretical linkages and purely 
speculative questions should i>e excluded . The remaining 
suggestions for additional research should be synthesized and 
listed in the appropriate space on Page 1 of the Abstract 
Profile. The statements should be explicit enough that the 
nature of the suggestions can be understood indepenc^ent of the 
abstract . After each suggestion, note in parentheses the docu- 
ment sequence number and year of document publication. 

STEP 9. List General and Unique Search Terms alphabetically in the 
appropriate spaces on Page 1 of the Abstract Form. 

A. General Search General Search Terms are derived from the 

Terms following sources: (1) a keyword list attached 

to the document, (2) the title and 
major paragraph or section headings, (3) the 
ISD activities or topics discussed, (4) types 
of media and media characteristics, (5) other 
types of instructional aids, and (6) experi- 
mental variables. 

A directory of the most frequently used 
general terms has been compiled and is 
attached to this handbook as Appendix IV. 
The terms you list on the Abstract Form 
should be among those listed in the Directory 
to Insure standardization. Consequently, 
you must become familiar with the Directory 
and not list a new term unless absolutely 
necessary (i.e., the term in question is 
clearly not a Unique Search Term). If you 
find a legitimate General Search Term not 
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B . Summary 
Statement 



listed In the Directory, you would attach 
a definition of the new term to the abstract 
as noted In Item 5 of the General Instruc- 
tions for Abstractors. Also note that some 
of the general terms In Appendix IV are 
preceded by an asterisk* These may be 
subject to misinterpretation and are defined 
In the Glossary attached as Appendix V, 
Many authors use new tenas__that can be 
4 described satisfactorily with existing ones, 

so be familiar with the Directory of General 
Search Terms and the Glossary . 

NOTE: If an author uses a term that does not 
appear In the Directory In the author's 
form, or as a synonym or cognate, the 
term should be considered for listing 
as a Unique Search Term. 

B. Unique Search Unique Search Terms are defined as possible 
Terms search terms which are not Included In the 

Directory of General Search Terms. They 
tend to be unique to the particular docu- 
ment. Most frequently they will Include: 
(1) system names, (2) acronyms, (3) trade 
names, (4) new terms that the author 
discussed In detail In the text, and 
(5) the names of ether authors whose work 
has had a clear and present Influence on 
the article being reviewed. 

STEP 10. The final step In the preparation of the abstract Is self- 
editing . Check the abstract for qua lity and style of writing ^ 
completeness, and general readability . The APA Publication 
Manual contains excellent suggestions for lmt>rovlng the quality, 
style, and readability of technical writing In Sections 2 through 
2.33 and 4 through 4*67. Become familiar with these suggestions 
and follow them whenever possible* 

When the self-editing Is completed. Indicate on Page 2 of the 
Abstract Form, the number of pages in the document and the 
number of references cited* Finally, Initial the Abstract 
Form In the appropriate space on Page 2. 




APPENDIX I 
SAMPLE TYPE I ABSTRACT 



er|c "z^** 
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ABSTRACT FORM 



SEQUENCE NO „ 

ABSTRACT TYPEj i ■ ft M, 



AUTHOR(S): Air Training Command 



TITLE: Instructional Systems Engineering 



PUBLISHER: Air Training Command, Randolph Air Force Baee> Texas 



REPORT NUMBER: ATCM 52-10 



DATE: March 1967 



GENERAL SEARCH TERMS: 

Criterion Test 
Data Collecting 
Design of Instruction 
Field Test 
Imp lemen t a t lo n 

Instruct iona 1 Materials Center 

Instructor Responsibilities 

Instructor Role 

Knowledge of Results 

Media, Selection of 

Pacing 



Plan of Instruction 
Programmed Instruction 
Response Mode 
SOLO 

Step Size 

Systems Approach to Training 
Task Analysis 
Task Identification 
Threshold Knowledge Test 
Try out 



UNIQUE SEARCH TERMS: 
None 



SUGGESTIONS FOR ADDITIONAL RESEARCH: 
None 



ERLC 



CROSS nSFEnENCE: (SEQUENCE NUMBERS) 

None 



FORM FOR ABSTRACTiNQ REPORTS IN TRAINING TECHNOLOGY 
27 



Sequence No> 12 



BIBLIOGRAPHIC REFERENCE: 

Air Training Command. "Instructional systems engineering". Randolph 
Air Force Base, Texas i Author, March 1967. ATCM 52-10. 



BODY OF ABSTRACT: 

Chapter 1 discusses the programmed instructional system — its origin 
and application in training. The emphasis of the article is on the 
systems approach as a new process which ends in the development of a 
complete learning environment. 



Chapter 2 discusses the programmed instructional system — its 
characteristics. Behavior, stimulus, and response are defined* Charac- 
teristics common to all programmed instructional systems are discussed: 

1. analysis of behavior 

2. controlled responding 

3. knowledge of results 

4. optimum step-size 
5r planned-pacing 

6. validation prior to implementation 

7. student centered 



Chapter 3 discusses planning curriculum analysis — a series of steps 
to determine course content and to develop an effective programmed 
instructional system for a course is outlined. 

Chapter 4 describes the general development activities. Reviewed 

are : 



1. Statements of learning objectives — guidelines, 
including sample statements of good learning 
objectives, 

2. The criterion test — guidelines on how to 
construct it . 

3. The threshold knowledge test — guidelines on 
its construction and use. (The threshold 
knowledge test, given to a sample of prospec- 
tive students before the course, is designed 
to help determine what to put into the course 
of instruction.) 

4. Selection of media — examples of ineffective 
media and media considerations. 

5. The production phase — editing process 
outlined. 
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Sequence No» 12 



ABSTRACT! CONT'D. 

Chapter 5 discusses the validation process* It Is accomplished In 
student sample tryouts (Individual and small groups) conducted by the 
system designer, and operational tryouts conducted by the course 
personnel. Guidelines are provided for conducting them. 



EVALUATION OF DOCUMENT: 

This paper providfes an excellent overview of the systems approach 
to Instructional design* It relates the process to some of the Important 
principles of learning. At the level of a general guideline, It succeeds 
In Integrating the practical and theoretical concerns of Instructional 
systems engineering. Some of the terminology employed (e.g*, SOLOs — for 
Statements of Learning Objectives) is no longer commonly used. Many of 
the topics are treated more comprehensively in other Air Force documents 
Including AFM 50-2. (P-32, R="12, SS) 
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SUMMARY AND EVAIUATION FORM 



1. CHECKIISTS FOR EVALUATING 
TYPE I & TYPE II DOCUMENTS 

tA, (NSTf^UCTIONS 

Th««« chiclili«(« tidt ior ty«lu>t«nf dMv >^ |/) t«. Ch^ck. it$<r\t enry In 
Lift IS 1C. Aii ^tttn^ m«y net tppry t9 * ip«c<'ic ^ecumtnt. 

• H in »t*m don net tPp'V In toy Aty. mtrk t^t N« boa if) |h| »OKI 10 

• l> • decwm«nl fully Mtittm •n ^tm t'lfioh. tr\$tk |K| 1 bo« 10 cht 

• • doc«'»*t«rooi? piMi«liy »*tiiti#» ittm cr-^*fion, m»f n ih| 
3 b«A to ih« iih et ihi <itm. 

• l( « documtni U.lt TO Ul>t<y $n Ittm criterion, rntih ihi 3 tMK to 

H >0w »n iXlT\ a or ff'tlif I b« Iff option »c>tlchp *p <r d#K»lb inj 

IB. EVALUATION CHECKLIST FOR TYPE I ABSTRACTS 
De$cr»piivi Siirtimary o' Contertt. 




1. T«tl« o'<to<ufr<«<^t d**cr<b«» coflttfiH. 

3. Httd'<r^ tra •wb^••tfir»9« Ovtimi conttr^tft. 
X ArM of lfil*<*«t It d«Kn«at*d clitf ly. 

4. MtMOnifordMltngMltM^U trtt BrtctMr. 
V PrOblV'Ti sr** \$ C0Mtr*d •dtqutttly. 

4. Aoo«0•C^ to probltm iria hi tporop'Ut*. 
). Lkmittt'orM of *ppro•C^ covtrtd. 
ft. Im<)0rt«'^t tferrfX til d«fin»(l. 

9. n«J*()o<iiMp of thit docu'T>«nt to ex^im r*i^int Itttitturt It iltttd. 

10. R»<l*Mf O^ rMMrc>< cl«*r ir^d COActMi 

1>. n^itMt ol '«*4«'cK tpacif y dtftlgn* •mplov*d, 

19. Grtphi «rvj tabit« p'::^->t*d cl*«'tv. 
13. CiKkclut^nt«f*tt*l*d«!a«rly. 

1C CoiHlu|]<»A|*r« »wbit*n|i|t>d by Vvidcnci prti»nt*d in iNl ^ufntnt. 
1$. Conclui^oni tn cor\l«n«d lo l^i pfOb'im d'tcumd in t>^t document 
IK. lif^lktt^ont fer fuluri «tM«rch »r< l9Bk*tly fo'<nultTl^, 
17. •'bN0«rw>hy P<OP«rly Or«anij»d *rkd prM«nl »tf cttwiy. 

Oarilv an() Uwfulnets: 

Ik, DocurA*n| don not rth*th •tT■bli|^•d prln<iplH 
If. Oocwmtnr prtMnlt ippHcitiont '■^»sJ«n| (0 ISO. 

20. Oocumtnr 0<tMnh CO«K»pt| r«l«wir>t lo ISO. 
ty. Cooctuttont trt impontr>l fo< ISO. 

Sty** of MTiDnf ri lOP'Oixliti for tVP><*1 ISO ut*rk. 
}3. Oocurnont rl Mritttrt ClMrfy, 

34. OoCurrvCCT t«rMior^b>y Uty lo foMOM end ri not confuting. 

}V To«>« of Ih* docurr^cfM dliotivt if^ unbttMd. lmo«rtI*l Kitntif ic ittirwdfV 



tC. EVALUATION CHECKLIST FOR TYPE II ABSTRACTS 




B 



{r>troducl!on: 

1. Titit of documtnt odtqwiTsty d««£i>E>«t conttnH. 

a. frobi««n it ttxtCd ClMrfy. 

), ff«M30t f »r im.'*tti«aiir>« pfobUm tf «lMr. 

4. Atiumeiioni »rt tlatfd dwrly. 

6. Limltttiom of lh« Itudy ftrt titttd. 
C. Importtnr Mrmtartdvf.nad, 

7. R*r«tlOntMp of iKt o'Ot>1»ry to pf«vl0wt rM««rch It ctnr. 

a, Prvwiout «««M'C>« It r«wl«M^*d •d«<iuat*ry fo« tutt^or't Purpo«««, 

i. HvpOlhM*! tr*t1tl*d C*Mr|y, 



] f 0. PpoutitfOA ^ «d«qvtar«<y diwcr'bod «t ro t'(«, foctt/on. fflt. uvl et#>«r 
Ch*r«citrrttlct rat^tnt to it^t tiMt'ch. 

11. Method of %a*<noVif\t It tdVOuMtly dctC'Ibod tr«d tt •oP'O^ittt. 

12. SaitvdIo Sttd*Qu«t»iy dotcrtbkd M to t^rt, locit^o, ag*, «r>d eth*' 

f tl^tnt ChtrKfirlfttCt. 
11 K*t*»rch dMifA It d*tcr)b«d fully. 

14. ^tttontlt t»f lOtcifk '•t««'ch d*«l»n It •daguittly ]u(tifl»d. 
19k llMMrch dM>0n It borl tuittd for tolut>on of th« probltrn, 
IC. Th« rffacti r^f lnd>p«fu}«r>t v*r i»t>lM «r« not COntoiir>d««1 «ll^ f*>* 
, vffsctt ot u ^ ontrolltd, l■rrt<^•owt w»'iabl#». 

I 1 I ( ] 17. Th« tfffacit of lr>dtp»ndO'\J wir1*bl*« in noi e*nfou<vd«0 i*lth th* 

*ff«ctt of motKttioi^tl wft^bl**. 
I r I I 1 Jt. Corttro/ froupt !/• •OP<P{X''aft l9f COm^rfion with •■ipOrimonul 

^ 9roup4. 

19, lnd«p«nd«r>r v|rLtbr*« irt tdtqutttly tp«Cif>*d. |Ou*llttllvtly ) 
}<1 D«{>«<Hf*nt vtrUbIt**'! wltqutttty lOic^fttd, (Qutlitttlvt^y > 
)1. VtrttbiM t^i Op«r«tlon*lly di^lntd. {Qu»rMltit^«. 9«r^«<»tly) 
22. ApO'Oprtttt rp>««|u'H*r* |*l«cr»d ^O* d«P«<Nd*nt «trr«bl*l 
22, C«ptrifT>«rirtr Ipvi I it^t wftM tayt ht mtnioul*tM 
3t. Co«>ditiont undor *vMch taperlmint vs»t C0n4juct»d V9 dttrly tC*clf>*d 

tr%d dt4^rt««t»d In tuff'ititflt d«iil. 
24, M^tAarth dniftn It fr»* of Ott^or tcocillc W*thn«tt««. 
2A, 0«t•^9•t^•r:n« (r«tbOd« or prockdum tr* dMtrib«d in lulfkltnt dittH 
to •flow r»clktllOn, 

[ } II I 27. 0«t»-B«tti«rJr.# <r>*it>od« or p#^0€»dufH folio* from th« rnM'Ch d«ttBn, 
_________ rr>«th«di o* proctdur«t art tppropf l*tt 10 t*>« lolution of tht pfobt^rv 

I I I I j 2t. 0»l»-gi t>»«r1n J rr«*thodi or oro<*durn do not InliodwC* ftrt^'tctu al b^MW 
Into data. 

I t I I i 24. A«t*«<ch«r ^•^ tthtn *oo'DlKiat« tttpt ro •li'TiJnttt or eOfttrol fo* 
•■p«rf(n«nt*r l-iM and Mll-fuKfilirva prop^tcy. 

Resulu: 



30. Oaic-Htha*^ moihodt or p/ooduroi tra ut»d coctctfy, 
)1. n«l[tbll>ty of rvMturlnf ir>it«Lirn«nrt It att«blith*dl 
22. Varidiry o* »T>«»Ki'in( Inttrumont* lt**t•b^^»^•d 
21. Apctroprttft mcthodt tri i»lact*d to k^t'yit t^<* dtt* In Ktordtnet 

Mith th09» >ndictt«d by th» fHM»ftt* dotign. 
34. M»it>«d4 u»*die »n*1yrt ttt« dart ara ut*d corractly. 
3V nwMlta ot tKa tntlytot »fi prKantad cImtIv. 

36. Gnp^tAr-J ftr« p<t>»nt*d c'ttrly. 

37. Only tl9^ifk»nt rnuitt '»/it>o<-'viC*d m maanin^ul datk, 
3& €onf>d*ncl art tta!*<a ciMrly and <f unw«ual. Jultifiod. 
19. UnututI it«tlttkar procadur«« or urvutual «pplk«riont «f ittndird 

^ proc»dur*i tr« dCK'ibOd dtkrty tnd >(Jttif iod. 

(~ I } 1 1 *a Trtniforrnoddct* V elaorly ip«c<fl*d M fcith and mtthodi ol eo'**tf»Jon 
V itjit*dc>M''y and frdMiutTt'v iu»tif;*d. 
Ditcuttioo: 

41. Concfi>t(ent t'a tlKodcfMrly, 

4}. Conch/«i««H ara lub«Mn|iar»d by t^« »»;d*ACa prmntod. 
«^ G«n*r|llt*t}<Vi«*r*«e«itin«d fo Xh» popwlat>«n from m^icft tho lAnrtpIt 
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L% \ J 44 Co(tc>rtioM« ralttt o«ly to th» par«rT*tir» of tf»a l«wttii»aii»r* ^^♦t 
- — - *«»a ip4erf-od undor •«p4f kfr>ont«l eoAdltlor^t 



SEQUf ^CE NO 



12 



_ 49k 1rt'»«antfal and lntt'PnU<rt con<lut^ont t't 
_ 46. 1l>far|ntr|l *nd inttrprtliva cor^lutPoni I't 
^ 47. SD*Cv1*t>ont, ffuatiM, tnd th^orUin^art nc 
Ihtl toHOA IfO^n tht dttt, 
( I 1 \ ] 4*. Ifnplkttiontfor >utw«t 'ti 



uFy «oac>^»d It Iwd 



M*d «| CO'^CIutiOOt 



t rtMarch t't logicti'v 'ormiiitttd. 
Clarity and Usefutnejj: 

*9. R«pO(t « «v':itan dktrlY. 
Ml Report It logictHy o'aaoiiad, 

naport It itttpr^tbly Mty tO foUOKV *nd >t rkoi contutin^ 
*2. loni o» t^.t rtporl d^tp'tyi tn unbiattd. l<not't>tl tc^tniific tttnuda. 

Aaport Itof rood ovt'an q^^t^ty. 

Atpori It ol 4mpo«ltnca to tha probla^ri vt. 



2, DOCUMENT X TOPIC 
PROFILE 






D«i«rnn;na Job (or Activity^ 
^frfocmtnci ft«44;ir*^nti 




X 
















Ortarmloa (ducatio'i or 
Tftining Rt<iui-tft*tntt 




X 


















Ovtt'min* 1 nttn^t normal 
ObjactlM*! 




X 


















Davt^p Jttt 




X 


















St^act Mtd>t MttNodi 




X 


















D«ri'op lnttruCt>ona' 
Mtiariart 




X 


















V«i]data ar^d B^wiit 
iMVuctionil M|t*fi|it 




X 


















CornMt InttrwCTlonaF 
^fOgrim 






















lutlk/ttt Intt'urt^ontl 
Program 




















Soacify: 





















3. MEDIA/JNSTBUCTIONAL METHODS DISCUSSED 

ZA. COMMUNICATION MEDIA 3E. VISUAL AIDS 



Aud>o: 

□ Badlo 

O ttpt Rtfcorda' 
a Rtcord ^lty«r 

□ Lltttn^ng Ltb 
VlautI: 

□ r.lmttrio ISOtot} 

□ Votion ^klu'a at f^vpatfrr'vt Loop/S'f«'tr? 

□ Ta>EbOtiii 
Q M.croforrti 

Audipvltwtl' 

□ Sound/Stkla P«oiactO« 

□ Ptlrriitrlo^SouiMf 

□ TilaviiiOn 

□ Motion Pktgra 

□ Motion ^ktvira H 
Rae*t1t^a Loop 

ENVIRONMENTAL ME01A/A<0S 

□ Si>Tvy<ator 

□ Ptrx y*tk Trilntr 

□ WholoTMk fraintr 

□ ^ro<adv/'ai Traintr 

□ Ganrn 

□ Rofa rity 

□ $oc>od*tnri 
S Oparationti Cqk/>pmtnr 



30. TUTORIAL MHOIA 

□ CAl CMI 

G Tt»c>ting M«chln»i 

□ taamlng |.«|> 

3D. MULTIMEDrA 



C'«Dhkt 
DChtnt 

□ OiH»arT>« 

□ G'ap^t 

□ lllwifrtt'Pnt/ 
D<t*in9i 

□ Photogrtpha 

CKt^'tMll 

□ Cut A Wayt 

□ Mo<1iupl 

□ Modtit 
P'Oiaciad Ima^o*. 

□ Opto^t 
P«0}ectiorH 

□ 0*•r^aad 
TraniptrtneiOt 

□ SlkJat 

3F. METHODS OF INSTRUCTION 

□ TutoritI 

□ Lactura 

□ RaciTtl'Oo 

□ OilCLittlOO 

H Damontt'atlon 
■ S«ll-|n||fMl<on 
I Simulation 

□ Ptr rrt.n!n» 
O Tatnrt T'Onin^ 



3G. OTHER. SPECIFY 

Actual Task Practice 



4. TYPES AND METHODS OF RESEARCH EMPLOYED 
(FOR TYPE II DOCUMENTS ONLY) 



4A. TYPE OF RESEARCH 

□ 6»tic 

□ L»b Study 

□ Aooiiad 

□ Fiild Study 
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4B, M£THOO OF RESEARCH 

D Mi4torkt» 

□ Oatcrlptita 
C CaM & f>t\>i 

□ 0»va1opm«ntai 

□ Ca.iUi Comoiratii^a 
or "It *oai F»cio" 

□ Corralat<on»1 

□ Trut Ci^lrr>»rvtaf 

□ OuatI ERb4rirT>«n|a1 

□ Aef>oA 

□ Or^ar, SP*.r*y . — _ 
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ABSTRACT FORM 



SEQUENCe NO. 

ABSTRACT ryPE: J-OC H 



AUTHOR(S): T. S. Baldwin fir L. J. Bailey 

TITLE: Readability of Technical Training Materials Presented on Microfiche 
Versus Offset Copy 

PUBLISHER: Journal of AnnUed Psychology 



GENERAL SEARCH TERMS; 

Media, Effects of 
Media, Evaluation of 
Media, Instructional 
Media, Preparation 
Microform 
Reading 

Tests, Construction 
Tests, Development 
Tests, Reliability of 
Training Materials 



UNIQUE SEARCH TERMS: 
Offset Copy 

Positive and Negative Microfiche 
Readability 



SUGGESTIONS FOR ADDITIONAL RESEARCH: 

Investigations of metl^ods for increasing the reading efficiency of microfiche 
materials and equipment should be conducted including assessing the effect of 
ambient lighting, screen glare and image sharpness. (1001/1971) 

Applications of microfiche materials for education and training purposes should 
be investigated. (1001/1971) 

Further research la needed to compare the learning rates of S^s using microfilmed 



materials with the learning rates of S^s using offset copies of the same materials. 
(1001/1971) 




REPORT NUMBER: Vol. 55 



DATE: 



1971 



CnOSS nEFEAENCE: (SEQUENCE NUMSEftS) 



None 
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Sequence No . 1001 



BIBLIOGRAPHIC REFERENCE: 

Baldwin, !• S*, & Bailey, L. J, Readability of technical training 
materials presented on microfiche versus offset copy, "Journal of 
Applied Psychology'', 1971, "55'' , 37-41. 



BODY OF ABSTRACT: 

The purposes of this study were to: (a) develop reliable end valid 
psychometric instruments, representative of Air Force training materials, 
that can be used for evaluating readability of several types of material 
presented in various visual media, and (b) conduct an experimental study 
in which these instruments were used to measure changes in readability as 
a function of medium of presentation. The authors hypothesized that 
(a) reader performance using black and white offset copy would be signif- 
icantly better than performance on either positive or negative microfiche, 
and that (b) reader performance would not be significantly different for 
positive versus negative microfiche. The authors cited a review of 
literature related to research application of microfilm (Field, 1968), 
noting Field^s conclusion that little recent, definitive work on the sub- 
ject has been published. The present study is important since it 
investigated the relative readability of microforms compared to offset 
copy and, hence, pertains to training in which microform materials are 
used. 

Psychometric instruments were developed from Air Force training matter 
and from other sources with the necessary face validity to represent Air 
Force material. These instruments consisted of 12 tests, three in each 
of the following four categories: (a) materials requiring the reading of 
continuing prose and short paragraphs; (b) material requiring the identi- 
fication of and discrimination among precise symbols and figures; (c) 
material using the skills employed in reading charts, tables, graphs, maps, 
and isometric and orthographic drawings; and (d) material requV Ing the 
skills used in reading schematics, block diagrams, wiring diagrams, flow 
charts, and nomenclature verif ication* All instruments were primarily 
speed tests, hence, the reliability of each test was determined by a test- 
retest procedure. The Spearman-Brown prophecy formula was used to 
estimate the reliabilities for the total tests^ lengths ; these reliabilities 
were acceptable ranging from .76 to .93 for 11 of the tests, but the 
flow diagram test's reliability (.59) wris unacceptable. 

Ss were selected from students in Personnel Awaiting Training Statua 
at Chanute Air Force Base, Illinois. Commanders of 13 student squadrons 
were asked to randomly select ^ight students per day for testing; these 
133 Ss were randomly assigned tS^ one of three groups: 43 in the positive 
microfiche group, 45 in the negative microfiche group, and 45 in the 
offset copy group. A between Ss ANOVA of Groups X Armed Forces Qualifica- 
tion Test scores showed no significant differences among groups, which 
the authors interpreted as indicating no differences in the general 
intelligence of the groups. 
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ABSTRACT, CONT'D* 

Each of the 12 tests were reproduced as offset copies, negative 
microfiches, and positive microfiches. Microfiche readers, deemed to be 
representative of the readers In use throughout the Air Force, were used 
to present the microfiches. Project personnel administered the tests 
using standardized test procedures and Instructors. Tests were adminis- 
tered In counterbalf^nced* sequences within each group to control for the i 
effect of fatigue. 

The Independent variable was medium of test presentation (positive 
or negative microfiche, or offset copy); the dependent variable was 
correct number of responses on each test. A between Ss ANOVA design 
was used to assess the effect of medium of presentation of the number of 
correct responses. A principal axis factor analysis of the Intercorrela- 
tlons among the 12 tests and Varlmax rotation of the extracted factors 
yielded communalltles that, when conipared with the 12 tests* reliabilities, 
indicated that a number of the tests had considerable specific variance. 
Consequently ANOVAs were computed separately for each test. 

Results on three of the 12 tests were significantly affected by 
medium of presentation; Test 7, graphs (F«3.5, df«2/130, p<.05); test 4, 
figure identification (F=»10.48, df«2/130, p<.01); and test 6, symbol 
translation (F-11.29, df«2/130, p<.01)* For each of these three tests, 
one-tailed t tests were used to test differences between me^n scores on 
offset copy and microfiche (since it was hypothesized that differences 
would favor offset copy), and a two-tailed t test was used to test differ- 
ences between mean scores on positive and negative microfiches. Signifi- 
cant differences (p<.02) were found for all three tests on the offset 
copy versus microfiche comparisons. 

The authors concluded that **METHOD OF PRESENTATION DOES AFFECT THE 
READABILITY OF THE MATERIAL ON THE GRAPHS, FIGURE IDENTIFICATION, AND 
SYMBOL TRANSLATION TESTS AND THAT OFFSET COPY GAVE BETTER READABILITY 
THAN EITHER NEGATIVE OR POSITIVE MICROFICHES ON THESE THREE TESTS. 

The authors noted that furtlier research is needed to determine the 
Influence of such variables as Image sharpness, ambient lighting, screen 
glare> etc., on readability of microfiche presentations. The authors 
also Indicated that research comparing learning rates (instead of correct 
items on single presentations of tests) as the dependent variable would 
be desirable to assess further the effects of medium of presentation. 



EVALUATION OF DOCUMENT: 

The title of this article failed to indicate the test development 
portion of the study, and the review of and relationship to prior research 
are poorly handled. The authors failed to describe fully the limitations 
of this study and the research design and its rationale} for example, the 
authors gave no reason for using ANOVA Instead of analysis of covarlance 
to control for Ss' intelligence* The population and sample were not 
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EVALUATION OF DOCUMENT, CONT^D* 

adequately described and there Is some question about the randomness of 
the S selection procedure. Rate of learning would be a better dependent 
variable • The authors did not specify the statistics to be applied in 
their design and seem to have selected them after the data were collected. 
In addition, motivational variables may have become confounded with the 
independent variable in that Ss seemed to prefer using microfiche readers. 

Non-independent t tests were used to evaluate the significance of 
groups* mean scores after ANOVAs were computed. The authors stated that 
they accepted the null hypothesis for nine out of the twelve tests used 
as the dependent variable, and nonsignificant results were listed. 

The authors did state their conclusions in a clear manner and stuck 
to the data in formulating them. The report is clearly written and 
logically organized, yet is still confusing. 

This article is only of fair quality overall, due largely to 
deficiencies in the research design and statistical analyses. However, it 
bears relevance to ISD, specifically to the selection of media and the 
preparation of training materials. Since microforms are becoming increas- 
ingly widely used in training applications, research such as that reported 
in this article is important, (P=5, R«2> RBP) 
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• lit (tocwnAnt fwi'v Mtn^.M »rt iiim e'<ii(<»^, fntru in* 1 be* K 

o' t^t <t«m, 

• H • tfe<um«>it Qi^'v pt«t ailv t4t *t *t ■'^ ifc'n er<far>6n. m«rt i^* 

• tit dOCu<T>«nt tt.^t to MMty m iltm CFittNo/t, <v^tFk tt«t 3 t«K to tt)« 

l»H 0^ tht it«m. 

18. CVALUATJON CHCCKLlST FOR TVPE t ABSTRACTS 
OetcripYivt Summirv of Coount: 

I, T)|l« Ol dOCuiTMnt d*tC'>bM COnllfVlt 

3. HMd<n«* ■nd'iiibKMdtro^ owrii/^* eeni*nti 
9. A'M ot intt<Ht <■ diliri*it*d ciairi/. 
C AMiont for diiimf th>t irM ir* c^Mr, 

P'oO>0'^ I'M It covO^M *<>»qwi(itr. 
%. Approach to probra<n ar*a l| •{>propria1». 
f. L'Prtitationi Ol approach ara cov»r*d. 
C lit^poria««t rarrT<i ac* aa^nt<}. 

1. naiatio«>*A'P ot it>'t docwr^arit to oih»r ra<«vant llt*ratur« ia atitAdL 
IOl n«k.a«>t a* '<n»trct\ ara t'aar ar^d co^cLm. 
\}. MffyiViAn of ra«««rch lp«city d«»<«ril *mplov*d 
17. O'M'^t a/>J taam «^a p't««n tod v> 

13. Co^'uoont ara itafM ctMr'y. 

14. CorH<uvO<M »fa twtntaniiattd by avidtflca p<M*M*d in th« documtrf^t 
It. Cor>ctwtlorit ara tontin*d to k'^a problar^ arM diKwMOd in lK« 4«cur<i«AL 
It. lmp(t<at>OM tor ^gt\»fo rM««/ch af* i»9kallv lormwl*l*d. 

BiWidi^aphv it pfopar'v »rg«na*d *nd p^OlAntM clMr<V. 

CUriiy «od UMfuMeu: 

la O0cum«nr doai ridi ra^Mb HtabiiaAad pr»rHiplM, 
IB. Dochirno^^t praMiit appiKatiom 't<«vafM to ISD. 
10. Do<w'n«nt pftt»*\ti co<x;«plt rarovant to >S0. 
31, ConcKiUpni ara irrip«<ian| tor iSO. 
33. Str'i At Mf'ting .a appfOpriatf tor tt-pieal >$0 u««rt. 
2X Docu<rt«nt 4 i^r>tfan c<aariv 

24. (>o<urr<ani ^ rMMnably M«v to tollQ^^nd H not e^ntuiin^ 
2ft. Tort« ti l^a docwmam dkap'ayi an ur>b<taod. imoirtha' Ki«nutit atiitwdc 




tC. EVALOATfON CHECKLIST FOR TVP£ It ABSTRACTS 

InlrOdoclron. 

I. T.Tia or dO<um«oi »d»gviat«<v dMcrtbai coniOf^ta. 
3. f robiam it Itafad Clavrty 

3. ffa*Mn» tor lrf«Mt>9atirk4 p/pblom ara clt*l, 

4. Awumpt'Oni ara itatid ciMrly. 

5. L*<*>iiat>oiior th* irwdv ara itattd. 
ft. Irnportar^l larmi Ora dafmM. 

1. ^arat onaMp of tha probla'n tP proviput r«tM««h ia cloar. 
t. ffavioiia raMa/cH <a ravia'^ad toaquataiy ^o* auihor't purpp 
t. K*p«thaa«« ara itatad ctaafiy. 
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10. fppuiation i| ad«qLat«iy d«acribad at to uta, tpcattprv tffi. otA* 
c*>aractarltf>ct 'a^avant to laaoarch. 

M. MnNpd of umphrf iaadaovaco^y d<»cr'k6ad artd ii app<6pri«t*. 
12. Sa^p'a ffMaouata'r 0a«crib«tf m td aU«^ ipcat^K, ««<i »n<i otf^*- 

ra«««aAt c^aractaiitt^v 
11 ^•••«<ch dai4giN ri d«K.nb«d tutiy. 

14. Rat>oi%«i* tot tp«C4t«c raaaarch dMigfi laadaqutTafy juttiliM. 

15. Aa«4a«ch d««i|n la b*«t twitad ic< to'uttpA of cA« pro6/l<iv 

Ifi. Tno a^ractt ot mdapan^arM vanabi** ar« aoi canfouodad «iltfi ih« 

aft acts ot urHfrntroltad, aitranaoua variafttai 
t7. Tha allacti ot lOdapaA^ant »»f]lblM ara r^ot conlownd«d writti tht 

,titl»cxt of <r>ot<vrt<«na> ^arlatstM. 

11. CVitrat %t^\iO* »>» Bppropfiata f»t co<r<p«^i»oA wrttK »*p«riin*At»l 

r»up«. 

19, lAaapandant va/>»b>M aft *daawat«i( ip«cithad. (OwaittatUary) 

30. D*p*Ada^t w«ria2)iai ara ai^oqwatoi* t^»f!ad. lOualiUtKWy) 

32. Appropriaia mMauro* ara lalactad tor dap«Ad*ot vafiabiM. 

33. EBp«r>rrontar <T>anipti>at«i lAihat ha »«vt Ka ^A<pwlal*k 

34. Co/^d)t>or| und«r Mtticn aapa«trn«nt w«« tO«\ductad ara ct««riy ipocitJad 
a^d dra<in4«t«<i >f> tufTicla^t dmtM>t. 

35. Rata*fCh a«ti«/i ^t tf a4 ot othar «>«c>r>« wMhrtaaM*. 

71, 0«la-»it^*r>r^ maihp^ ft« proctdwiaa v«daacrit*d in «utf»cl*<it datall 

lu allo<» r*gl>caiion. 
2T. Oat•■9al^•r>r>f rn«thfrd4 or p^KMuraa talloM trom 1M r aaacf cK dM'tA: 

fT-t^hoat 6* ptoc^^uft ara appropfiata to tr« lotutio^ ot iha problorn. 
it. Oat»-»ith«r.n| rr>«ihoda «< prt>co<tufBt do rvot inirodkxi •'tlt«c(ual bl*aoa 

into daffc 

3«. PaM*/ch* hat tan an app'opr^it* itaip* to atirriiruta 0/ conirpi fo* 
aip«r»(n«r)iat biat and taH fuif tlltr^ p«ephacv. 

Xl Oata-M*^**^>i^l nsathodl 0« procMwrOa ara u»*d corractlv 

31. Aaliabiiitv ot TvaiawriCg mttrwrnArtta ia Htafaliahad. 
Ti. V«ld<tv 0< «r>Mi<fir>«<nttru«T>«fvti .| HtablVahOd 

yX Appropriata matKpot ara Mi*:t*i lo arai*!* tM data in aecord«nc« 

M)ith #<Pi* indkatad by <ti* r»»*afch dat^r^ 
X U«t'to<»t fatM t« aft«\(« t**» d«t« a''a waad cOfracHt- 

ffoauitt 0< analy*** an pfAMntad Claorly. 
34. CrjpM taCiiaa ar« pr aaant*d ct««rlv. 
9>. O^'v l>4<^«tKani »a»uin ara «nupdijc*d ai rT)««<^inglul diU, 

39. Conf^iarxa t«v«'i ara atatad ci**<'lv aftd >4 un^h<a(. iutti>«d. 

lb. U^vutvar itat^atKa^ p/pcad^dra* or ur^*L<ai app^icationi ot tt*Ad«rd 
prccaduraa ara d«icribad irpariy and fwttitiod. 

40. Tran«fdr<t«*d tfati «ra ilaariy iPAeif ad at luch a«fd m*rt«M« o< c4<t»^t<on 
ara »taf c laar I * a^d adaooaioty iw«»itiad. 

0>icviision: 

4). Cpn<tut<orvtar« *!ai*d citariv- 

42. Cor^h/««<WH ar« lwb<tant'atPd by tfi«*v;daA£« prn0rtt»a. 

G •r-.ar«i1 j«t>P<^ I A'a cftnt»A4d tP tha population rrp«n M^kh t^a ipmpla 
Matdrt'Mft. 

44 Cenclv»'«na (t*at« prgy to tt<4 p«iam«tari of i4>a iAkartiHt'dt t^at 
tr^tra ipocif>«d un<N»r a>p4rirn*nui e«fvi»itrpni 
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45, (nVafiii«i ar^ iniarp4«ii«a e»nciwiiorii *ri tiaaiiy ipacitiad at tucK 
4<, Inta^BAtlAJ and ir^itrprtt^i epAOwi^ona ya Iwttitiad, 
4?. Spaculatipni, fu*»««i, and ih«orlaln| tra r%c\ prttortad M corKikiilona 
tf^x fo((e«k from t^a da<a^ 

44. imprteariona f«r Vlwr* rM*«rch *ra >p«kal/y >«<(nw^aiM. 

CUrity and Utcfulneii: 

4». Xapprt k Mritianciaariy. 
^0, ffapo'i »i lo»<eaiiv ortfanirxL 

n«p«rt i| raaaoiably Mty io tol^tv tr^ H noi eoitui>r»^ 
^2. ToA« of (ha rapori diipiav« a'^ utbi«»o4, tmpanial acltniific attitudA 
tl. ^apori la pi 900d evorall ctuality. 
^ napprt la o' imperfnt a tp tha p/ob^ani a'*4 
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3. M£OFA/lNSTRUCTIONAL METHODS DISCUSSED 
3A. COMMUNICATION M£OiA 3E. VISUAL AIDS 



□ radio 

□ ra.'»a npcprdpr 
0 npcord fiaypr 
O l.itta'^lnf Lab 

Viauali 

O F^lmitr-p tSilant) 

Q McitbA P^turaot napptlthia l,o«p|Silar^i) 
QTaxTbooh 
S UiCfofom 
Aud<«wl«jal; 

Q Sourto^llda frojpcio* 
O Fiimttrfpi'ftoMAd 
O Tal*rl»Jon 
Q Mo(>PA f*ctura 
0 Motion f ktura 
llapailil«a i.«op 

38. ENVIRONVENTAtik^EOIA/AIOS 

Q $«mg(»t«r 
'■ O fari-Taali Trainar 

□ WtvQ;»Ta«h Tr«ir\«r 
O rrocadur*t TrainOf 

□ Liamat 

□ ^o^riav 
Q SocipdrartvA 
Q Opa^attorsal Equiprrvont 

3C. TUTORIAL WEOIA 

0 CAt/CMI 

Q frpflfam»»>#d Te«t 

□ Taachlr>« Machinea 
0 L«arn^n« Lpb 



Cf»f>h)c$ 

Q Olpframa 
Q GrapM 
Q niwttratlofia/ 

Q fh«tpr*«*« 

EKhibita: 

8Cu1-A Wav* 
Mockvpt 
UpdPla 
Piojbctad lm*ffa«: 
Q Op»<Kia 

TraAip«ftncl«« 
0 tlkdM 

3F. METHODS OF INSTRUCTION 

8Tvlpf)a< 
taetura 
O Rac^tJtion 
□ DIWuW)«A 
Q Oampottratrp^i 
0 ti<VMtat^ 
0 ^atr Tralfi)n9 
Q Ti«m Training 
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3G. OTHER: SPECIFY 

Offset Copies 
Microfiche Readers 



4. TYPES AND METHODS OF RESEARCH EMPLOYED 
(FOR TYPE II DOCUMENTS ONLY) 



4A. TYPE OF RESEARCH 

Qtatic 

■ CablMdy 

■ ApptM 

0 fitta Study 



48. METHOD OF RESEARCH 

0 MtftPrteal 
□ D«MrlptK« 
0 Cpaaft riPU^ 
0 C>*«.tppfri*nui 
Q C*u«al Cemppraliv* 
a# -fa rptt f^acro" 

0 Corriiat<pAjl 

1 Trua Exparlmpotaf 
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APPENDIX III 
APA PUBLICATION MANUAL EXCERPT* 



*Copyrlght (1967) by the American Psychological Association and 
reproduced by pernilssion. 
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8.1 General Rules 

8.1 1 Accuracy of citation. Accuracy and completeness of citations is of 
major importance. The purpose of listing the references is to make pos- 
sible their use by the reader; this purpose cannot be accomplished if the 
reference data are incorrect or incomplete. The list of references should be 
carefully checked against the original publications. If original sources are 
unavailable, but the reference is important enough to be included, the 
secondary source from which it was secured should also be indicated. 
Special attention should be given to spelling of proper names, spelling of 
words in foreign languages (including accents or other special marks), 
correct journal titles, years, volume numbers, and pages. 

8J2 Capitalization. Only the initial letter of the first word of the title 
of a book or article is capitalized, with the following major exceptions: (a) 
The first word of a secondary title following a colon is capitalized (e.g.. 
Studies in perception: A new method); (b) proper names, German 
nouns, etc., are capitalized; (c) the first word of a title v/ithin a title (e.g., 
Report on "Cognitive versus inhibitory learning"). 

8.13 Punctuation. Special attention should be given to accuracy and 
uniformity of punctuation. Titles are not enclosed in quotation marks. 

8.14 Italics. Only book and journal titles should be underlined to indi- 
cate italics. 

8.2 Arrangement of References 

8.21 Heading. The list of books and articles cited should be labeled 
References, or, if only one book or article is cited. Reference. 

8.22 Authors' names. Arrange entries in alphabetical order by author's 
surname, or for multiple authors by the name of the senior (first-named) 
author, (a) Names are given in inverted order — followed by the initial 
or initials only for both male and female authors (e.g., Clarke, P., not 
Clarke, Peter). For married women, use the surname as given in the pub- 
lication cited. In typing, each initial is followed by a period and a space. 
Failure to space between initials is a common error, (b) In the case of 
multiple authorship, the inverted order is used for all names, with each 
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name separated from the preceding name with a comma. The final name is 
preceded by a comma and an ampersand (&). (c) References to an author 
alone stand first, followed by those of which he is the senior author. Refer- 
ences with one senior and different second or third authors are arranged 
alphabetically by the surname of the second author, etc. (d) Several refer- 
ences to the same author or authors are arranged by year of publication, 
the earlier first. References of the same year are arranged alphabetically 
by title (excluding "a" or ''the"), and lower-case letters in parentheses — 
for example, (a), (b), etc., — are placed after the final period of each such 
entry. Note that the author's name is repeated in each entry in the follow- 
ing examples; do not replace the name by a dash. 

Jones, C. L. Proprioceptive stimuli. Journal of Experimental Psychology, 
1957,54, 27-30. 

Jones, C. L. Perception of space. Journal of Experimental Psychology, 

1958,56,3-17. (a) 
Jones, C. L. Space factors. Journal of Applied Psychology, 1958, 42, 

91-102. (b) 

8.23 Entries with no personal author. Entries for which no person is 
indicated as author may be divided into three classes: (a) corporate author 
indicated, (b) article signed **Anonymous," and (c) neither of the preced- 
ing. 

a. When a corporate author is clearly indicated, the accepted practice 
follows. Examples will be found in the list of references at the end of this 
manual, specifically American Standards Association (1959). 

/. A corporate author may be an association, a government agency, a 
business firm, etc. 

a. The full official title of the corporate body should be used; for ex- 
ample, American Psychological Association, Psychological Corporation, 
United States Department of Defense. 

A subdivision of a larger unit is entered with the larger body first and 
the subdivision following; for example, American Psychological Associa- 
tion, Policy and Planning Board; University of Michigan, Department of 
Psychology. 

/V. Corporate authors are arranged in proper alphabetical position with 
personal authors. 

b. Articles signed "Anonymous'* are arranged with this word as name 
entry in the alphabetical list. 

c. Entries for which no author is evident should be arranged by title 
(disregarding the articles **lhe," "a,'' "an") in the alphabetical list. Ex- 
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amples will be found in the list of references of this manual, specifically 
Webster's (1964), 

8.24 Rules for alphabetization. The following rules govern special cases 
of alphabetization: (a) Prefixes M\ Mc, and Mac should be alphabetized 
as they actually appear; that is to say» Mc should appear in its logical order 
in the list and not as though spelled Mac. Abbreviations such as St. and Ste. 
should also be alphabetized as they appear, and not as though spelled out. 
(t) Compound names are alphabetized under the first part of the name: 
for example, KJoos-Knies, P.; Lewis-Jones, H. (c) Article and preposition 
prefixes (de, la, du, von, van der, della, etc.) govern alphabetical position 
according to different rules for different languages. Inasmuch as the prefix 
when included in Anglicized usage is commonly spoken as part of the sur- 
name, the APA journals alphabetize according to the prefix. In certain 
names — for example, (von) Helmholtz — the prefix is not customarily used 
in English and the alphabetization then disregards it. (d) Certain languages 
have roman letters not in the English alphabet — Danish se, and aa; 
Norwegian ce, </>, or o, and a or aa; Swedish a, and o; and Spanish ch, 11, 
rr, and n. Strict rules would require proper alphabetization according to 
their language, but practical considerations have dictated that APA journals 
alphabetize them as though they were accented variations of roman letters. 
This practice is analogous to usage for transh'terations from nonroman 
alphabets. 

8.3 Forms of Book Entries 

Most of the needed instructions can be obtained from the examples 
which follow. Books that are published annually, such as the Annual Review 
of Psychology, are considered periodicals (see Section 8,4). A few special 
directions are: 

a. Place of publication. Give only the city if the name is distinctive and 
well known. Give the city and slate (or city and country) if there arc 
several cities of that name (e.g., Springfield, III.) or if the city is obscure. 

b. Publishers name. Give in as brief a form as will be fully intelligible; 
for example, McGraw-Hill, not McGraw-Hill Book Co. (but Ronald Press). 

c. Citing pages. Particular pages of a book are never cited in the 
reference list. Specific page references to identify a quotation arc given in 
the text (see Section 8.6). 

8.31 Book. Cite author, title, city, publisher, and year, in that order. 
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Jeffords, C. V., Jr. The psychology of industrial unrest. New York: Mc- 
Graw-Hill, 1960. 

New edition. Note that edition is abbreviated (ed.). 
Jeffcrds, C. V., Jr. The psychology oj industrial unrest. (2nd ed.) New 

York: McGraw-Hill, 1964. 
Clarke, P. W. Psychological study of the Navajos. (Rev. ed.) Berkeley: 

University of California Press, 1966. 

8.32 Edited book and specific chapter. Note that **Editor" is abbre- 
viated (Ed.). 

Kelly, J. T. (Ed.) Theories of psycho pathology. Springfield, III.: Charles 
C Thomas, 1965. 

Wood, A. The reinforcement of anxiety. In J. T. Kelly (Ed.), Theories 
of psychopathology. Springfield, 111.: Charles C Thomas, 1965. 

8.33 Work of several volumes. 

Lochren, H. R. Collected works. London: Oxford University Press, 1938- 
40. 4 vols. 

8.34 One volume of multivolume work. 

Coleberg, E., Matthews, T., & Cooper, S. I. Approaches to educational 
psychology. Vol. I. Basic principles. Boston: Houghton Mifflin, 1963. 

8.35 Author as publisher. If an author is also the publisher, use 
'^Author" for the identification of the publisher, 

Branam, F. P. A new theory of taste. Chicago: Author, 1960. 
Program Development Corporation. Program for supervisory training. 
Smithfield, Ohio: Author, 1964. 

8.36 Author's name in title and collected writings. 

Neckerman, S. F. Collected papers of . . . New York: Ro'idan Press, 1965. 
Harris, N. C. (Collected writings) In V. H. Cook (Ed.), Educational 

psychology: Contributions of N. C. Harris to the field. New York: 

Ronald Press, 1950. 

8.4 Forms of Periodical Entries 

The bold-faced arabic figures used in the illustrations refer to volume 
numbers. 

8.41a Journal titles. Titles of journals in the reference list and in text 
in APA publications arc spelled out in full. 
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8.41b Journal article, pagination by volume. 
Archer, P. W. The tactile perception of roughness, American Journal of 
Psychology, 1950, 63, 365-373. 

8,41c Journal article, pagination by issue. Use issue number (in paren- 
theses following the volume number) only when the journal has independ- 
ent pagination for each issue. 

Cardinal, M. H. Anxiety among displaced children. Bulletin of the World 
Federation for Mental Health, 1950, 2r4), 27^35. 

8.42a Monograph with volume number, issuv number, and serial (whole) 
number, 

Follette, J. Relation of intelligence to motor skill. Psychological Mono- 
graphs, 1950, 62( 14, Whole No. 287). 

8.42b Monograph without volume number. 
Merewede, D..R. Measurement of teachers' attitudes. Teachers College 
Contributions to Education, 1960, No. 643. 

8.42c Monograph supplement, 
Graham, J. G. Effects of environment on reaction time. Journal of Ex- 
perimental Psychology, 1968, 76(4, Pt. 2). 

8.42d Annual Periodicals. 
Polis, R.F. Leadership style, hierarchical influence and theoretical implica- 
tions. Proceedings of the 74th Annual Convention of the American 
Psychological Association, 1966, 1, 39-40. (Summary) 

8.43 Abstract, 

Newell, N. B. Vocabulary as a function of adult age. American Psycholo- 
gist, 1951, 6, 420. (Abstract) 

8.44 Secondary source. While references should, whenever possible, be 
checked with the original, in a few cases pertinent material is available only 
from a secondary source. Inclusion of such references is permissible with 
the secondary source indicated. 

Harkavy-Katz, S. Hayclod hahole b'shituk mohi v'hayeled hamongloidi 
b'hayey hemisphaha. Harefuah, 1952, 43, 10-71. J(Psychological Ab- 
stracts, 1953,28, No. 1182) 

Smithers, E. F. Mating Behavior. Midland Annals of Natural History, 1 892, 
6, 4-8. Cited by A. N. Gora, Amphibian biology. London: Baker & 
Smith, 1949. P. 63. 
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8.45 Book Reviews. 

Gandt, W. P. Review of J. T. Singer, Selected works. (2nd ed.) Content- 
porary Psychology, 1957,2,272-273. 

8.46 Government reports. The bibliography of reports from govern- 
mental agencies, especially the near-print reports of research projects, is 
exceedingly complex. No single rules for citation can be formulated. 
Psychological Abstracts has used bibliographic entries of the book or 
journal article form with the addition of identifying d|ta such as Project 
Number, Contract Number, or the name of the contractor. The basic 
principle is to give sufficient information so that the interested reader may 
secure a copy from a library or the issuing agency. A practical suggestion 
to authors is to cite such reports as they have been cited in Psychological 
Abstracts. 

8.47 Report submitted to an agency. 

Smith, A., & Rauch, J. Effects of environment on intelligence. (USPHS 
Tech. Rep. No. 175) Washington, D.C.: United States Government 
Printing Office, 1967. 

8.48 Republication. Cite the reference you actually used; then, in 
parentheses following the final period, place the words **Originally pub- 
lished," a colon, and only that portion of the information which is novel. 
Jones, E. A. The ego. New York: Harcourt, Brace & World, 1965. (Orig- 
inally published: Leipzig: Verlag Press, 1958.) 

8.5 Unpublished Materials 

8.51 Dissertations. Authors should make every effort to secure Univer- 
sity Microfilm numbers for doctoral dissertations. If unavailable on micro- 
film, the second form may be used: 

Williams, S. R. The measurement of nystagmus in normals and schizo- 
phrenics. (Doctoral dissertation, University of Vermont) Ann Arbor, 
Mich.: University Microfilms, 1959, No. 59-297. 

Lijhtburn, L. T. The relation of r itical fusion frequency to age. Unpub- 
lished doctoral dissertation. University of New Jersey, 1951. 

8.52 Papers presented at scientific meetings. 

Strebor, K. Sociopsychological study of motivation. Paper presented at the 
meeting of the New England Psychological Association, Boston, April 
1966. 
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8.53 Symposium. 

Farnum, D. F. (Chm ) Motivation. Symposium presented at the meeting of 
the American Psychological Association, Philadelphia, August 1963. 

8.54 Contrilyution to symposium. 

Seis, C. E. Behavior and awareness. In V. A. Berg (Chm.), Research and 
interpretation. Symposium presented at the meeting of the American 
Psychological Association, Chicago, September 1965. 

8.55 Material ''in press/' An article or book accepted for publication 
but not yet in print may be designated as ''in press." In the reference list it 
follows all other references by the same author. Provide all information 
possible at time of writing. Often the reference can be completed by the 
time the author receives proof. A paper that has merely been submitted 
but not accepted by a journal should be footnoted. 

Sedlack, J. A. Rorschach indicators of anxiety. Journal of Consultini{ Psy- 
chology, 1967, 72, in press. 

Marks, G. Academic and nonacademic accomplishment. Boston: Little, 
Brown, 1965, in press. 

8.56 Other unpublished manuscripts. These works should not be cited 
unless the manuscript is on file with the NAPS or available from a library. 
Give author, title, the words ''Unpublished manuscript,'* the library where 
it is available, or NAPS document number, and the date. 

Jones, K. M. Measurement of teachers' attitudes. Unpublished manuscript, 
Columbia University, 1964. 

8 57 Personal communications. All references to these communications 
should be in the text only (J. Barnes, personal communication, July 18, 
1970). 
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Directory of General Search Terms 



Ability 

^Accelerated Speech 

Achievement 

*Achlevement Test (See also Tests; 
Measurement) 

Acquisition (See also Test) 

Acquisition Curves 

Active Participation (See 

Participation of Learner) 

*Adaptlve Techniques 

*Adjunct Programming 

Administration (See Management) 
*Advance Organizer 

Age 

Aid 

Aid, Job Performance (See *Job 
Performance Aid) 

*Aids , Instructional 

Analysis 

Data (See Data Analysis) 
Learning (See Learning Analysis) 
Mode (See *Mode Analysis) 
Systems (See Systems Analysis) 
Task (See *Task Analysis) 
Test 

Animated Panel 

Animation 
Techniques 

Anxiety 

Application (See Implementation) 

Approach Training 

Aptitude 
Patterns 
Scholastic 



*Term defined in glossary. 



*Aptitude Test 

Assessment Technique (See 
*Evaluation) 

*Association (See also Paired- 
Associate) 

Attention 

Attitude 

Attitude Restructuring 

Audience Aspirations 
*Audio Materials 

Audio Tape 
*Audio-Vlsual Media 

Auditory Training Aids 

Aural Learning (See Listening) 

Auto-Ins tructlon 
*Device 

*Program [See also Programmed 
Instruction (PI) ] 

Autonomy 

*Baseline Data (See also *Entering 
Behavior) 

Behavior Modification 

Behavior Theory 

Behavioral Analysis 

*Behavloral Objective (See also 
*Criterion Objective; 
*Teaching Step) 

Bibliography 

Bibliography Included 

Black and White 

Blackout Ratio (See Detail, Amount o 

*Branch (See also *By-Passing) 

Branching Programming (See *Intrinsi 
Programming) 
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*By-Pas3slng (See also ^Branch) 

CAI [See *Computer-Asslsted 
Instruction (CAI)] 

Case Study 

Charts (See Graphics) 

* Chaining 

Conversational 
Retrogressive 

Chalkboard (See also Media) 

CMI [See *Computer-Managed 
Instruction (CMI)] 

Cognition 

Color 

Coiiiment.ary Variations 

Communication 

Conununloatlon Channels 

Communication Modes 

Comprehension 
Span of 

Compressed Speech (See *Accelerated 
Speech) 

Computer 

*Computer-Assisted Instruction (CAI) 
[See also *Computer- 
Managed Instruction (CMI)] 

Computer Language 

*Computer-Managed Instruction (CMI) 
[See also *Computer- 
Assisted Instruction (CAI)] 

Computer Program (See *Software) 

Computer Prograraaer (See *Pro- 
grammor^ Computer) 

*Concept 

Learning 

Conditionings Classical 

Conditioning) Instrumental 

*Conf irmatlon (See also *Knowledge 
of Results; *Feedback) 

*Constructed Response 

Content 
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Contingencies 

Contingency Management (See Behavior 
Modification) 

Controls 

Conventional Methods 
*Cost-Ef fectiveness 

Course Evaluation (See Evaluation, 
Course) 

Course of Instruction 

Criterion 
Behavior 
Development 

Evaluation (See *Criterion Test) 
Frame (See *Terminal Behavior 
Frame) 

*Objective (See also *Measurement , 
Criterion Referenced) 
Referenced Measurement (See 
^Measurement , Criterion 
Referenced) 

*Test (See also *Terminal Behavior) 

Cue (See also *Prompt) 
Attention Habits 
Pattern 

Curriculum 
Design 
Development 
Revision 

Cutaways 

Data 

Analysis 
Collecting 
Flow Analysis 
*Processing 

Decision Aid 
*Decislon Logic Table 
*Decision--Maklng 

Delay 

Demonstration 
Design Guidelines 
Design of Instruction 
Detail, Amount of 
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Device 

Devices » Instructional 

*Dlagnostlc Test 

Diagrams (See ^Visual Materials} 
Graphics) 

Dial Access 

Dialogue 

Difficulty Indices 

Difficulty Level 

5^1f fusion 

Discovery 

*Dls crimination 

Frame (Se^ Frame, Discrimination) 
Learning 

Discussion 

Displays (See *visual Materials) 

Distortion 
Perceptual 

Speech (See Speech Distortion) 

Distributed Practice (See *Practlce, 
Distributed) 

Draisatlzed Experiences (See Role 
Play) 

Drill (See Practice) 

Enabling Objective (See *Teachlng 
Step) 

Engineering Education (See 
*Technical Training) 

*Enrlchment 

*Entering Behavior 

*Environment 

Environmental Media (See *Media, 
Environmental) 

Equipment (See Operational 
Equipment 5 Training 
Equipment) (See also 
Hardware Aids) 

*Error Rate 



^Evaluation (See also Measurement) 
Course 

Criterion (See *Crlterlon Test) 
Instructional Materials (See 
Materials, Evaluation) 
(See also Media, Evaluation of) 
*Kethods 
Program 

Self- (Self -Evaluation) 
Student 

System (See System Evaluation) 

Experience 

Experimental Design 

Explicitness (See Detail, Amount of) 

Extension Course 
*Extlnction 

Facilities (See *Envlronment) 
*Fading 

Feasibility Study 

*Feedback (See also *Knowledge of 
Results) 
Augmented 
Confounded 
Direct 

Field Survey 

*Field Test (See also Testing) 

Field Trip 

Film (See also Motion Picture) 
Commentary 
Loop Demonstration 
Viewing Practice 

Films, Organizational Outline in 

*Fllinstrlp (See also *Medla, 
Instructional) 

*Filinstrlp Projector 

Fixed Procedure 
*Flight Training 

Follow-- Up 

*Frame 

Discrimination 

Multiple-Choice 

Practice 
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G-Pactor 
Gain 

Games (See *Slmulatlon) 

^Generalization 

Glossary 

Graphics 

Group 

Discussions 
Instruction 

Pacing (See ^Pacing, Group) 
Tryout (See Tryout) 

Guided Discovery 

*Handbook 

*Hardware 

Hardware Aids (See also Media; 
Projector) 

Hlgh-Fldellty 

Human Factors 

Function Allocation 
Human Engineering 
Man-Machine Interaction 
Systems Analysis (See Systems 

Analysis) 
Task Analysis (See *Task 

Analysis) 

Implementation (See also 
Management) 

Incidental Learning 

Independent Study 

Indirect Learning 

Individual Differences 

Individualization 
Partial 

Individualized Instruction 

*Indlvidually Prescribed Instruc- 
tion (IPI) 

Industrial Training 

Information Processing 

Information Retrieval 

Information Transfer 

O 
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Innovation 
Input Load 
Instruction 

Instructional Aids (See *Alds , 
Instructional) 

^Instructional Materials Center 

Instructional Media (See *Medla, 
Instructional) 

Instructional Objective (See *Behavloral 
Objective) 

Instructional Outcomes 

Instructional Set 

Instructional Systeju*(See *System; 

*Sys terns Approach to Training) 

Instructional System Development (ISD) 
(See *Sys terns Approach to 
Training) (See also Design 
Guidelines; Design of Instruct- 
tion; Systems Method) 

Instructor 

Characteristics of 
Effectiveness 
Evaluation 
*Guldes for 
Orientation (See Instructor Training) 
Responsibilities 
Role 

Selection 
Training 

Instructor's Station 

Intelligence 

Intentional Leaxning 

Intentions 

Interference 

Intermittent Reinforcement (See 
*Relnforcement, Partial) 

Interview 
Group 

Individual 
Observation 

^Intrinsic Programming (See also 
*Branch) 

Inquiry Mode of Instruction 
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Irrelevant Infortnatlon 
Isolation 
*Job 

Analysis 
Description 
Inventory 
Knowledge Test 

Job Performance 
*Job Performance Aids (JPA) 
*Job Performance Requirements 

Job Training 
*Klnescope (See also Television) 
*Knowledge of Results 
*Learner-Centered Instruction (LCI) 

Learner Characteristics 

*Learner-Controlled Instruction 

Learner Resource Center (See 

*Instructional Materials 
Center) 

*Leaming 
Analysis 

Center (See *Instructlonal 
Materials Center) 

Curve 
Early 

Facilitation 
Factors Affecting 
Hierarchies 
Laboratories 

Objective (See ^Behavioral 

Objective) 
Principles 
Rate 
Sets 

Theories 

Types (See also Listings of Spe- 
cific Types of Learning) 

Lecture 

Programmed 
*Standard 

Lecture-Discussion 

Lesson Plan [See *Plan of Instruc- 
tion (POI)] 

Library (See Information Retrieval) 

*Linear Programming 



Listening 

Logistics 

Low-Fidelity 

Management 

of Research Agencies 

of Students 

of Training Syetems 

Maintenance Training Device 

*Manipulanda (See also Media) 

Man-Machine Interaction (See Human 
Factors, Man-Machine 
Interaction) 

Mass Media 

Massed Practice (See *Practice, 
Massed) 

Materials, Evaluation. 

Materials, Preparation 

Materials, Validation 

Mathematical Models 

*Ma the tics 

Meahingfulness 

Measurement 

*Crlterion Referenced 
Instrument 

Methods of (General) 
*Norm Referenced 
*Performance 

*Technlques (See also *Evaluatlon) 

Media 

Characteristics of 
*Communi catl on 
Cost 

Effects of 
*Environmental 

Evaluation of 
*Instructional 

Mass (See Mass Media) 

Preparation 

Resource Center (See ^Instructional 

Materials Center) 
Requirements 

Research in (See Research, Media) 
Selection of 

Types of (See also Listings of 

Specific Types of Media) 
Utilization of 
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Methodology 

Evaluation (See *Evaluatlon 

Methods) 
Instruction 

Measurement (See Measurement , 

Methods of) 
Selection 

Systems (See Systems Method) 
Training (See Methodology, 
Instruction) 

Microform (See Printed Material, 
Microform) 

Military 
Law 

Training 

*Mock-Ups (See also Media) 

*Mode Analysis 

Model (See also Media) 
*Hardware 

*Scheinatlc or Description 
Modules 

Motion Picture (See also Media) 

Motivation 

Motor Skills 

*Mul timed la Approach 

Multiple Choice Questions (See al 
Frame, Multiple-Choice) 

*Multl-Track Course 

Negative Reinforcement (See 

*Relnf orcement , Negative) 

Non-Declslon Aid 

Nonsense Syllables 

Norm Referenced Testing or 
Measurement (See 
^Measurement , Norm 
Referenced) 

Note-Taking 

Objective 

Behavioral (See *Behavloral 

Objective) 
Criterion (See *Crlterlon 
Objective) 

Observation Skills 
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Officer Training (See Military 
Training) 

*On-the-Job Training (OJT) 

*Opaque Projector (See also 
Projector; Media) 

Operational Equipment (See also 
Hardware Aids) 

Operational Tryout (See *Fleld Test) 

Optimization Techniques 

Optimum Viewing Conditions (See 
Media Requirements) 

*Overhead Projector 

*Paclng 

Automatic 
*Group 
Self- 

Palred-Assoclate 

Partial Relnfor cement [See '^Reinforce- 
ment, Partial (zr Intermittent)] 

Participation 
Covert 
Overt 

Participation of Learner 

Part-Task Practice (See *Practlce, 
o Part-Task) 

Pattern of Learning Ability 

Perception 

Perceptual Learning 

Perceptual Motor Skills (See also 
Motor Skills) 

*Perf ormance 
Aid 

Aid Detail 
Aid Format 
*Criterion 
Job 

Measurement (See *Measurement , 

Performance) 
Standards 
Test 

Training 

Periodic Reinforcenent (See *Relnforce- 
ment Schedules) 
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Personnel 
Assessment 
Selecitlon 

Training (See Job Training) 
Phonograph 
Pictorial Test 

Picture (See ^Visual Materials) 

*Plan of Instruction (POI) 

Positive Reinforcement (See 

*Relnf orcement , Positive) 

*Post-Test 

Practice 

Covert 
^Distributed 

Frame (See Frame, Practice) 
^Massed 

Materials 

Overt 
*Part-Task 
*WhoIe-Task 

Predictive Device 

Pre-Fllm Test (See *Pre-Test) 

Presentation Methods 

Prestige Rate 

*Pre^Test 

Principles Learning 

Printed Material 
Microform 
Textbooks 

Prior Learning (See ^Entering 
Behavior) 

Problem Solving 

Procedure 

Instructional 

Procedures Trainer (See *Trainer) 
(See also Media, Charac- 
teristics of) 

Processing, Data (See *Data 
Processing) 

Product Development 

Proficiency 

Proficiency Level 
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Profile Analysis 

^Program 
Dens Ity 
Evaluation 
Instructional 

Self-Instructional [See *Auto- 
Instruction Program, Pro- 
grammed Instruction (PI) J 

Programmed Instruction (PI) [See 

also ^Teaching Machines; 

*Computer-Assisted Instruction 

(CAI)] 
Editing Techniques 
Lecture (See Lecture, Programmed) 
^Material 
Objective (See also ^Behavioral 

Objective; ^Criterion 

Objective) 
Principles 

Procedures (See Programming 

Methods) 
Scheduling 

System (See *System; ^Systems 

Apprcach to Training) 
Televised (See also Television) 
*Text 

Tryout (See also Tryout) 

Programmed Interaction Objective (See 
^Behavioral Objective) 

Programmer 
^Computer 

*Programmed Instruction 

Programming Methods [See also ^Program; 
Programmed Instruction (PI) J 
Adjunct (See ^Adjunct Programming) 
Branching (See *Intrlnslc Pro- 
gramming) 
Chaining, Conversational (See 
Chaining, Conversational) 
Chaining, Retrogressive (See 
Chaining, Retrogressive) 
Computer (See ^Programmer, Computer) 
Instructional fSee ^Programmed 

Instruction (PI)] 
Intrinsic (See *Intrinslc Programming) 
Linear (See *Linear Programming) 
Mathetlcs (See *Mathetlcs) 
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Projector 
Film 

Opaque (See *Opaque Projector) 
Overhead (See *Overhead 

Projector) 
Rear-Screen (See *Rear-Screen 

Projection) 
Slide (See *Sllde Projector) 

*Prompt 

Partial 

Psychoanalytic Framework 

Psychology 

Punishment 

Qualitative Indices 

Quality Control 

Questionnaire Survey 

Radio 

Rate 

Controlled Speech (See 

*Accelerated Speech; 
*Rate Expanded Speech) 

Error (See *Error Rate) 
^Expanded Speech (See also 

^Accelerated Speech) 
Learning (See Learning Rate) 
Time (See Time Factors) 

Rating Profile 

Reaction Time 

Reading 

Realism (See also *Simulatlon) 

*Rear-Screen Projection (See also 
Media) 

Reasoning (See Thinking) 

Recall (See also Retention) 
Free 

Short-Term 

Recognition 
Training 

Recording Time 

Redundancy 

Regression Analysis 



^Reinforcement 
Delay of 
*Negatlve 

^Partial (or Intermittent) 

*Positlve 

^Schedules 

*Reinforcer (See also ^Reinforcement) 

Repetition (See Redundancy) 

Research 
Media 

*Resource 

Resource Requirements 

*Response 
Code 

Confirmation (See ^Knowledge of 

Results; *Feedback) 
Constructed 

Contingencies - 
*Covert (Passive) 
Differentiation 
Error (See *Error Rate) 
Free 

Guidance 

Mediating 
*Mode 
*Overt 

Processes * 

Retention 
Delayed 
Immediate 

Retroactive Inhibition 

Review 

Role Play 

*Scrambled Book 

Self-Evaluation 

Self-Instructional Program (See 

*Auto-In8truction Program) 

Self -Paced (See Pacing, Self-) 

Sequence 

Instructor Generated 

Learner Generated 

Ordered 

Scrambled 

Subconcept 



58 



^Sequencing 

^Shaping 

Signal Detection 

^Simulation 

by Computer 

*Slmulator 

Complexity 

*Slngle Concept Film 

Skill Training 

*Sllde 

*Sllde Projector (See also Media) 

Social Issues 
*Sof tware 
*Sound/Sllde 

Speaking 

Speech 

Acceleration (See *Accelerated 
Speech) 

Compression (See *Accelerated 

Speech) 
Distortion 
Rate 

Rate Expansion (See *Rate 
Expanded Speech) 

Spontaneous Recovery 

Statement of Learning Objectives 
(SOLO) (See *Behavioral 
Objective) 

*Step 
*Slze 

Stereoscopic Sound Film 

*Stlmulus 

Characteristics 

Code 

Control 

Complexity (See Stimulus 

Characteristics) 
Devices 

Differentiation 
Encoding 
Factors 
*Mode 
Presentation 
Uncertainty 



Stimulus /Response Factors 

Strategies for Instruction [See 

also *Plan of Instruction 
(POI)] 

Stress 

Student Evaluation (See Evaluation, 
Student) 

Subsets 
*Subsystem 
Supervision 

Symbolic Diagram (See *Model, Schematic) 

Symbols 

Syntax 

*System (In General or Instructional) 
Capability 
Engineering 
Evaluation 
Maintainability 
Reliability 
Requirements 

Systems 

Analysis 
*Approach to Training 
*Design (in Education) 

Method 

Tachistoscope 

Tape (See Audio Tape; Videotape) 

*Target Population 

*Task 

* Analysis 

Classification 

Complexity 
*Description 

Familiar 12 at ion 

Identification 

Information Content Level 

Inventory 

Repetitive 

Organization 

Overloading 

Performance 

Predictability 

Psychomotor (See Perceptual 
Motor Skills) 

Statement 
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Taxonomies 

Teacher (See Instructor) 

Teaching Effectiveness 

Teaching Equipment (See *Alds, 
Instructional; Devices, 
Instructional) 

*Teachlng Machine (See also Device) 
Requirements 

*Teachlng Step (See also *Crlterlon 
Objective) 

Team Training 

Teams 

Technical Conference 

*Techuical Training 

Technique 

Adaptive (See *Adaptlve 
Techniques) 

Television 

Educational (ETV) 
Instructional (ITV) 
Instruction Recordings 
Live 

*Terminal Behavior 
*Frame 

Testing 

Psychometric Methods 

Tests 

Achievement (See *Achlevement 
Test) 

Aptitude (See *Aptitude Test) 
Construction 

Criterion (See *Criterion Test) 
Criterion Referenced (See 

*Measurement , Criterion 

Referenced) 
Development 

Diagnostic (See ^Diagnostic Test 

Field (See *Field Test) 

Norm Referenced (See *Measure- 

ment, Norm Referenced) 
Proficiency 
Question Types 
Reliability of 
Retention (See Retention) 
Threshold Knowledge [See 

*Threshold Knowledge Test 

(TKT) } 



Tests (continued) 
Scoring 
Self-Scoring 
Validity 

Textbook (See Printed Material, 
Textbooks) 

*Threshold Knowledge Test (TKT) 

Thinking (See also Cognition) 

Time Factors 

Time Sharing 

Tracking Task 

Traditional Teaching (See 

Conventional Methods) 

*Tralner 

Part-Task (See also ^Practice, 

Part-Task) 
Procedural (See *Tralner) 
Whole-Task (See also *Practlce, 

Whole-Task) 

Training Center (See *Instructlonal 
Materials Center) 

Training Equipment 
Selection of 

Training Goal (See *Behavloral 
Objective) 

Training Materials 

Media (See *Medla, Instructional) 
Mer.hod (See Methodology, Instruction) 
Task Fidelity 

Training Officer 

Training Requirements 

*Transfer of Training 
Intermodal 
Mediated 
Negative 

)*Transparencles 

Trials 

Troubleshooting 

True-False (See Tests, Question Types) 
Tryout (See also *Fleld Test) 
Tutorial Mode of Instruction 
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Typographical Arrangement (See 
Printed Material) 

Unsyntactical Structure 

*Validation (See also *Fleld TestJ 
Tryout) 

Verbal 
Ability 
Behavior 
Communication 
Introduction 
Learning 

Videotape 

Vigilance 

^Visual Materials 

Visuals, Use of (See also Media, 
Utilization of) 

Whole-Task Practice (See 

^Practice, Whole-Task) 

Work (See *Task) 

Writing 

Effectiveness 
Material 
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Accelerated Speech 



Achievement Test 



Adaptive Techniques 



Adjunct Programming 



Advance Organizer 



Recorded speech which, by one of a variety of 
techniques has been compressed (e.g», by com- 
pressing pauses and shortening vowels) to per- 
mit presentation at a faster rate then normal 
speech* Accelerated speech has been reproduced 
at rates up to ADO wpm while still providing 
satisfactory comprehension and retention. 
See also Rate Expanded Speech* 

A test for measuring an Individual's progress 
in the mastery of a subject to be learned* 

Any of several techniques used in programming 
to accommodate individual differences. It may 
permit the student to by-pass material he 
already knows or may provide him additional 
instruction as needed. See also By-passing, 
Branching . 

A programming technique in which the instruc- 
tional program supplements a handbook, techni- 
cal order, regulation, or other source of 
information. The program is intended to in- 
struct the student in the use of the material 
it supplements or to expand upon the content 
of the material it supplements. Presumably, 
once the student has completed the '"adjunct" 
program, the main body of information can 
stand on its own. See also Intvinsic, Linear, 
and Mathetlcs Programming. 

An Introductory statement that describes the 
general concepts and materials to be covered 
during Instruction. A technique commonly used 
is to present a student with a list of the 
behavioral objectives which describe what he 
will be able to do at the end of instruction. 



Aid, Job Perforniance 
Aids, Instructional 



See Job Performance Aids (JPA) 

Devices which assist an Instructor in the 
teaching-learning process by simply presenting 
supporting or supplementary material usually 
intermittently. They are not self-supporting. 
The key fact is that aids support, supplement, 
or reinforce. See also Media, Instructional, 
Media, Communication, and Media, Environmental. 
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Aptitude Test 

Association 
Audio Materials 

Audio-visual Media 

Auto-lnstructlon(al) 
Device 

Auto- Ins true tlon(al) 
Program 

Baseline Data 
Behavioral Objective 



A test or battery of tests designed to show a 
person^ s capacity for a particular type of 
behavior In a single field or In several 
reh.ted fields. 

The connection made between a stimulus (input) 
and a response (action) • 

Those Instructional materials which communicate 
via sound, e.g., cassettes, cartridges, and 
other audio tape recordings* 

Devices that employ visual and auditory aids 
to learning, Including motion pictures, tele- 
vision, sound fllmstrlps, and slide/sound sets. 

Systems and machines, Including Individual 
reading pacers, Individual viewing and listen- 
ing equipment, language laboratories, programmed 
printed materials, and teaching machines de- 
signed to present a program of Instruction 
without the aid of a live Instructor, 

Synonymous with programmed Instruction, auto- 
mated teaching, self-Instructional materials, 
etc. ^ 

A compilation of statistical evidence which Is 
used as a representative of an achievement or 
a behavioral pattern before any new instruc- 
tional process Is Introduced, It becomes the 
foundation against which the results of new 
Instructional processes will be measured and 
compared to determine Improvement In perform- 
ance time, cost, manpower, etc. 

Also called Instructional objective, learning 
objective, programmed Instruction objective, 
and Statement of Learning Objective (SOLO), 
An explicit statement that describes the educa- 
tional Intent of a segment of instruction. The 
statement(s) must describe what the learner 
will be DOING when demionstrating the terminal 
behavior and must (1) identify and name the 
overall behavior act; (2) define the Important 
conditions under which the behavior is to occur 
(givens or restrictions or both); and (3) 
define the criterion of acceptable performance. 
The statement of objectives for an entire course 
of instruction will consist of a number of 
specific statements* 
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Branch 



By-passing 



Chaining 



Communication Media 

Computer-Assisted Instruc- 
tion (CAI) 



Computer-Managed Instruc- 
tion (CMI) 



Concept 



Confirmation 



Constructed Response 
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In programmed instruction, a point of choice 
at which students are sent to alternative items 
depending on their responses to the particular 
item. See also Intrinsic Programming and By- 
passing. 

A technique which permits a student to skip 
certain portions of the programmed materials 
because of prior knowledge. A criterion item 
may be inserted in a linear program and, if 
the student passes It, he is sent forward 
several items (by-passing); if he fails the 
criterion item, he. takes an intervening 
sequence of review or remedial items* 

The linking together of a series of discrimi- 
nable responses in a particular order. The 
completion of the first responses provides the 
stimulus for the second response. 

See Media, Communication. 

The technique of using a computer program with 
necessary central and terminal equipment to 
instruct a student. The computer controls the 
material presented to the student and selects 
the next step on the basis of the student* s 
response. CAI employs the intrinsic (branching) 
method of programming. See also Teaching 
Machine and Intrinsic Programming. 

CMI uses a computer to administer the instruc- 
tional process but relies on conventional or 
multi-media hardware and software. The student 
is on-line for testing, diagnosis, and pre- 
scription only. 

(1) Any object of awareness together with its 
significance or meaning; anything one can think 
about that can be distinguished from other 
things. (2) A general meaning, an idea, or a 
property that can be predicted of two or more 
individual items. (3) Knowledge that is not 
directly perceived through the senses but is 
the result of the manipulation of sensory 
impressions . 

Notification to the student of the correctness 
of his response immediately after his response. 

An answer requiring recall or completion as 
opposed to recognition, e.g., drawing a diagram; 
filling in a form; labeling the parts of a piece 
of equipment; writing a sentence, paragraph, or 
essay . ; 
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Coat-effectiveness 



Criterion Evaluation 
Criterion Frame 
Criterion Objective 



Criterion Test 



A comparative evaluation derived from analyses 
of alternatives (actions^ methods, approaches, 
equipment, weapon systems^ support systems, 
force combinations, etc.) In terms of the Inter- 
related Influences of cost and effectiveness In 
accomplishing a specific mission or objective. 

See Criterion Test. 

See Terminal Behavior Frame. 

Criterion objectives specify precisely what 
behavior Is to be exhibited, the conditions unde 
which behavior will be accomplished, and the 
minimum standard of performance. Criterion 
objectives describe only the behaviors which 
directly lead to or specifically satisfy a job 
performance requirement or standard. Thus they 
are differentiated from the more general term, 
"behavioral objective. 



Test to determine If termln 
fleeted In terminal objectl 
May Involve multiple-choice 
essays, or actual performan 
given immediately after lea 
is a test of acquisition ; 1 
later, it is a retention te 
ment, Criterion Referenced 
Referenced* 



al behavior as re- 
ves has been acquired 
items, fill-in items 
ce of a task. If 
rnlng sequences, it 
f given consi.derably 
St. See also Measure 
and Measurement, Norm 



Cue 

Data Processing 
Decision Logic Table 



Decision-making 



Diagnostic Test 



See Prompt. 

The preparation and handling of information by 
procedures that classify, sort, calculate, 
summarize, and record. These procedures may be 
manual, mechanical, or electronic. 

Guide to assist in the decision-making process. 
Represents the Inputs or set of Inputs likely to 
occur for a given situation and recommends a 
course of action or. If appropriate, alternative 
actions. Also called Decision Table. 

Choosing a course of action on the basis of 
facts, opinions, and other information relevant 
to the decision. 

Attempts to identify specific student learning 
problems or determine whether students are pro- 
gressing satisfactorily towards a particular 
instructional objective. 
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Dlf fus ion 



Discrimination 



Distributed Practice 
Enrichment 

Entering Behavior 



Environment 



Environmental Media 
Error Rate 

Evaluation 



Describes four types of activities which include 
(1) dissemination (the act of dispersing and 
spreading educational ideas, information, and 
products); (2) promotion (the act of obtaining 
interest and commitraent to the new idea, infor- 
mation, or products); (3) infusion (the act of 
introducing the product into the operational 
setting; and (4) sustainment (the act of insur- 
ing continued use of the new product). 

Learning to make different responses to similar 
stimuli. A discrimination item is one which 
requires the student to determine the differences 
among inputs. 

See Practice, Distributed. 

Supplementary material which aids the student 
in progressing through the course but Is not 
considered crucial to learning. 



Past educational achie 
population* Includes 
performance , school co 
received, instruction 
Sometimes includes oth 
be relevant to develop 
economic status, ethni 
physical /psychological 



vement of the target 
information about school 
mpletion, type of training 
patterns, and test scores* 
er information which may 
ment plans such as social/ 
c/racial background, and 
deviations • 



The sum of the external conditions and factors 
within an instructional situation potentially 
capable of influencing a student, e.g., lighting, 
furniture , temperature, color. 

See Media, Environmental* 

Generally the percentage of incorrect responses 
on an item, a set of items, or a whole program* 

Procedure to determine the effectiveness of the 
performance of an Instructional product or 
process In order to ascertain specific causes 
for the effectiveness or lack of it, and to 
make decisions appropriate to the extent of the 
effectiveness . 



Evaluation Methods 



Extinction 



Include methods (test. Interview, etc.) used to 
assess student performance after completion of 
a course of instruction and to assess Instructor 
performance, effectiveness of a training aid, etc. 

The weakening of the tendency to make a response 
by not reinforcing the response when it occurs. 
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Fading 



Feedback 



The progressive diminishing of prompts within 
a teaching sequence so that all prompting Is 
absent from the terminal frame* Sometimes 
used as a synonym for vanishing. See also 
Prompt; Terminal Beha^or Frame • 

Information which results from or is contingent 
upon an action. The feedback does not neces- 
sarily indicate the rightness or wrongness of 
an action. See Knowledge of Results. Rather 
it relates the results of the action from 
which inferences about correctness can be 
drawn. Feedback may be immediate^ as when a 
fuse blows because a lamp wa& Incorrectly wired > 
or delayed) as when an instructor provides a 
discussion pertaining to an exam taken the 
previous week. 



Field Test 



Tryout of any training course on a representa- 
tive sample of the target audience to gather 
data on the effectiveness of instruction in 
regard to error rates, criterion test perform- 
ance » and time to complete the course. 



Fllmstrlp 



Fllmstrlp Projector 



Flight Training 



Frame 



Also called strip film and slide film. A 
length of 35mm or 16mm film containing a suc- 
cession of still pictures Intended for pro- 
jection one at a time in the same way as slides 
are shown. Some fllmstrlps arc equipped with 
a tape or a recording that contains not only 
the narration but also a subsonic signal tha4: 
activates a solenoid to advance the fllmstrlp 
to the next picture on cue. 

Projection instrument designed to accept 3Smm 
fllmstrlps either vertically or horizontally. 
It is often equipped with an adapter to accept 
slides. Models are available with manual, 
remote control, or automatic advance. 

That portion of military training devoted to 
acquisition of all flying skills, including 
navigation, meteorology, piloting, etc. 

In programmed instruction a segment of material 
which the student handles at one time. An item 
may vary in size from a single incomplete sen- 
tence, question, or Instruction to perform some 
response, up to a sizable paragraph. In almost 
all pro?^ramming methods it will require at 
least one response and will provide for knowl- 
edge of results before the student proceeds to 
the next item. See also Step. 



ERIC 



70 



Generalization 

Group Pacing 
Handbook 

Hardware 

Individually Prescribed 
Instruction (IPI) 

Instructional Aids 

Instructional Materials 
Center 

Instructional Media 

Instructional Objective 

Instructional System 

Instructional System 
Development 

Instructor^ Guides for 



Intrinsic Programming 



Learning to respond to a new stimulus similar, 
but not Identical, to one that was present 
during original learning. 

See Pacing, Group, 

A reference, guide, or prescriptive manual 
which covers all or part of a process or per- 
formance. 

The physical components of a system (usually 
electronic or electrical devices) which are 
utilized In educational processes Including 
computers, terminals, audiovisual devices, 
teaching machines, etc. See also Software. 

A course of study or program fitted to the 
Individual learner's background, abilities, 
and training needs. In which the learner selects 
his own materials and proceeds at his own pace. 

See Aids, Instructional. 

Also called Learning Center or Resource Center. 
A learning environment which has been specifi- 
cally developed to foster Individualized 
Instruction and which emphasizes employment of 
media. Including cosnputers, to augment text- 
books and manuals. 

See Media, Instructional. 

See Behavioral Objective. 

See System and Systems Approach to Training. 
See Systems Approach to Training. 



Publications designed to provide the adminis- 
trator of Instructional materials with Infor- 
mation about the objectives of the materials > 
the procedures Involved In their development , 
suggestions for their optimal use, and des- 
criptions of what might be expected from the 
materials, based on their previous effectiveness. 

A progranmlng technique developed by Norman 
Crowder , characterized by rather lengthy Items, 
multiple-choice responses, and consistent use 
of branching. If, after reading the Infor- 
mation section of each Item, the student 
selects the correct response, he Is sent to 
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Job 



Job Performance Aids (JPA) 



Job Performance Require- 
ments 



Kinescope 



Knowledge of Results 



Learner Centered Instruc- 
tion (LCI) 



Learner Controlled Instruc- 
tion 



Learning 



an item presenting new information! If he 
selects an incorrect alternative, he is sent to 
an item which provides information as to 
why his choice was incorrect. See also Branch; 
Adjunct, Linear, and Mathetics Programming. 

The composite of duties and tasks actually 
performed by an individual* 

Devices, books, charts, or other references 
which facilitate job performance by reducing 
the amount of information the human performer 
must recall or retain in order to successfully 
carry out a task. The pictorial guide on a 
movie projector showing the path for threading 
the film is a job performance aid for the 
projectionist , 

The tasks required of the human component of a 
system, including the associated standard of 
performance . 

Motion picture films made by photographing the 
images produced on a television picture tube# 

A report to the student on the correctness of 
the response. It may be verbal report such as 
"right" or "wrong" or a display (verbal or 
visual) of the correct response* 

An instructional process following Instruc- 
tional Systems Development procedures to insure 
direct job relevancy of the learning materials. 
For example, an LCI approach to electronics 
maintenance training would not contain only the 
traditional fundamentalo of electronics required 
for satisfying the job performance requirements* 

Involves an instructional environment in which 
the student has a variety of instructional 
options that can be selected for achievement 
of the terminal objectives. Students can vary 
their rate of learning, the media used, etc. 

A change in behavior as a result of experience* 
The behavior can be physical and overt, 6r it 
can be intellectual or attitudinal. 



Learning Objective 



See Behavioral Objective. 



Lecture, Standard 



A discourse given before an audience Or class 
for instructional purposes* 



Linear Programming A programming technique In which set flequences 

of frames In small units require a response 
from the student at each step* The steps are 
so designed that errors will be minimal for 
even the slower students In the target audience. 
Each student does each Item In the program, his 
progress differing only In rate at which he 
proceeds through the sequence. See also Adjunct 
Linear^ and Mathetlcs Programming. 

Manlpulanda Physical objects designed to be handled by 

students for Instructional purposes. 

Massed Practice See Practice, Massed. 

Mathetlcs A programming method that stresses the analysis 

and arrangement of subject matter and the 
systematic application of scientific training 
techniques. Four technical phases of mathetlcs 
are the task analysis, prescription of behavior 
(statement of objectives), characterization of 
the prescription (detailed analysis of behavior 
to be taught and strategy to be used)^ and exer- 
cise writing. 



The process of determining, as objectively as 
possible, a student ^s achievement In relation 
to a fixed standard based on criterion objec- 
tives. See also Criterion Objective. 

The process of determining a student's achieve- 
ment In relation to other students. Grading 
"on the curve" Involves norm referenced 
measurement since an Individual's position on 
the curve (grade) depends on the performance 
of other students. 

Measurement, Performance The process of determining If the student's 

performance on a given task reaches the 
criterion level set as the standard for that 
specific task. 



Measurement > Criterion 
Referenced 



Measurement, Norm 
Referenced 



Measurement Techniques Techniques for measurement of student learning 

may Include: quizzes, pre- and post-tests, 
self-evaluation, Instructor evaluation, etc. 

Media, Communication Systems or Instruments which present a complete 

body of Information and are largely self-- 
supporting rather than supplementary to the 
teaching-learning process. Cotomunication may 
be one-way (e.g. , television, films, slide/tape 
presentations) or two-way response media (e.g., 
programmed instruction, CAI) . See also Aids, 
Instructional; Media, Instructional; and Media, 
Environmental. 



Medld» Environmental Equipment, devices, or situations which create 

an artificial environment that will realistically 
stimulate a learner and react to his 
responses (actions or manipulations), thus 
providing practice in relatively complex behav- 
iors that require special environment. The 
environment simulated may be applied to (1) 
concrete and self -contained systems such as 
airplanes and automobiles, (2) more abstract 
systems such as the national economy of a 
country, or (3) real-life person or persons 
with whom the student is being trf-^ined to 
interact. See also Aids, Instructional; Media, 
InSitructlonal; and Media, Conmunication, 

Media, Instructional Any component of the instructional system which 

presents or provides stimuli to the learner. 
See also Media, Communication; Media, Environ- 
mental; and Aids, Instructional. 

Representations of the real thing, constructed 
so as to emphasize the particular function of the 
real thing, TViey may be smaller or larger than 
the original; parts of mock-^ups may be opera- 
tional or non-operating; certain features may 
be made so as to give emphasis to functions or 
relationships. 

The analytical process by which characteristics 
of behavioral objectives are examined to deter- 
mine the nature of the stimulus mode required 
to teach the objective. The primary modes are 
audio, visual, and sensori-motor . 

A scale replica or representation of reality. The 
scale may be miniature, exact size, or enlargement, 
andv the model Itself may or may not be manipulative 

A demonstration of the performance or graphic aid 
v/hich the student is to use as a standard or 
example (a model) to guide his p^^rformance. 

Depends on the use of more thdn one type of 
instructional medium as a vehicle for present- 
ing the instructional materials. Character- 
istically, an Instructional package which 
employs a multimedia approach may use text- 
books, fllmst slides, and manipulanda to pre- 
sent various segments of the entire package. 

A course which employs more than one track or 
channel of instruction* Course goals are the 
same on all channels, but course content , 



Mock-ups 

Mode Analysis 

Model^ Hardv;are 

Model, Schematic or 
Description 

Multimedia Approach 
Multi-track Course 



Negative Reinforcement 

Norm Referenced Testing 
or Measurement 

Objective , Behavioral 

Objective, Criterion 

On-the-job Training (OJT) 



Opaque Projector 



Overhead Projector 



Pacing 



Pacing, Group 



Partial Reinforcement 



degree of instruction, and presentation all 
vary to accommodate students of different 
aptitudes and levels of previously acquired 
skills and knowledges. 

See Reinforcement, Negative. 

See Measurement > Norm Referenced. 



See Behavioral Objective. 
See Criterion Objective. 

On-the-job Training is a systematic application 
of self-study and the craftsman-apprentice 
principle, characterized by the trainee's 
being permitted to practice on operating equip- 
ment, with supervision by a knowledgeable 
worker and/or Instructor. 

A projector which can project small non- 
transparent Images, such as maps> pictures, or 
printed pages, onto a screen as enlargements. 

A device which throws a highly-Illuminated 
image on a screen by reflection from a mirror} 
it is placed in front of the audience and may 
be used in a semi-darkened or completely lighted 
room; utilizes 3-1/4" x 4'', 7'' x 7", and 10*' x 
10" transparencies and specially prepared 
objects which may be produced and presented in 
a variety of ways. 

The rate at which the student proceeds through 
a given number of items. The usual procedure 
in programmed instruction 1;^ self-pacing — the 
student reads and responds at his own rate. If 
materials are presented by such means to a group, 
the time allowed for input and for response 
must be standardized through group-pacing. See 
also Pacing, Group. 

A procedure in which student^^ progress together 
toward the same objectives; often employed 
where self-pacing is not practical for adminis- 
trative reasons* >^ 

See Relnf orcettfent, Partial (or Intermittent)* 



Part-task Practice 



See Practice, Part-task. 



Performance 
Performance Criterion 

Performance Measurement 
Plan of Instruction (POI) 



Positive Reinforcement 
Post-test 

Practice, Distributed 
Practice, Massed 



Practice, Part-task 
Practice, Whole-task 

! 

Pre-test 



The carrying out of an act to completion; actual 
accomplishment of a task to some preset standatd 
of completeness and accuracy • 

A standard used to determine whether or not the 
student has achieved a satisfactory level of 
performance. Sixty words per minute Is the 
usual criterion for satisfactory performance 
as a typist. 

See Measurement, Performance. 

A qualitative course control document designed 
for use primarily within an Air Force School 
for course planning, organization, and opera- 
tion. Generally, for every block of instruc- 
tion within a course, criterion objectives, 
duration of instruction, and suport materials/ 
guidance factors are listed. 

See Reinforcement, Positive. 

A test given tO a student upon completion of a 
course of Instruction to measure learning 
achieved. See also Pre-test. 

During learning, the process of spacing numerous, 
relatively short, practice sessions throughout 
the learning period. See also Practice, 
Massed. 

During learning, the process of providing all 
practice sessions at a specific point in the 
learning period (usually at the end of instruc- 
tion). This is generally considered inferior 
to distributed practice. See also Practice, 
Distributed* 

An exercise, performed with or without a train- 
ing device, which allows students to practice 
some portion of a task or set of tasks. See 
also Practice, Whole-task. 

An exercise, performed with or without a train- 
ing device, which allows students to practice 
an entire task at one time* See also Practice > 
Part-task, 

A tesf given to a student prior to entry into 
a course of instruction to determine the 
technical skills and knowledges (entering 
behavior) he possesses in a given subject. 
See also Post-test. 



Program 



Programmed Instructlon(al) 
(PI) Material 



Programmed Instruction 
(PI) Text 



A sequence of planned steps or increments which 
leads the student to mastery of the subject 
while minimizing uncontrolled error. The 
student is required to actively respond to each 
step and is given immediate feedback as to the 
correctness of his response. The distinguish- 
ing characteristic of programmed materials Is 
the testing procedure to which they are sub- 
jected* Empirical evidence of the effective- 
ness of each teaching sequence is obtainable 
from the performance records of students* 
See also Intrinsic Programming and Linear 
Programming, 

Instructional material prepared specifically 
to employ techniques of programming* Sjmony- 
mous with auto-instruction, automated teaching, 
etc* See also Program* 

A book in which a program is usually printed 
in one of three typical formats: page-to-page, 
down-the-page, or scrambled* In the first 
type» the student tuims the page after each 
frame or item, finding the answer and the next 
item on the following page* Generally, items 
are arranged in levels* The student goes 
through the book doing all the items on one 
level, then repeats the process for each 
successive level* A down-the-page format 
requires the student to mask the answer column 
and in some cases everything but the item he 
is working on as he reads down the page* See 
also Scrambled Book. 



Programmed Interaction 
Ob J ective 



See Behavioral Objective* 



Programmer , Computer 



Programmer, Programmed 
Instruction 



Individual who prepares instruction sequences 
and who deyelops the step-by-step operations 
which are to be performed by the computer in 
order to solve a problem* 

The person responsible for the design of items 
and sequences in a program, The programmer 
may be a psychologist working with a subject- 
matter expert who delineates the content, or 
he may be a subject-matter specialist trained 
in programming techniques* 



Prompt 



Rate Controlled Speech 
Rate Expanded Speech 



Rear-screen Projection 



Reinforcement 



Reinforcement, Negative 



Reinforcement, Partial 
(or Intermittent) 



A stimulus added to the terminal stimulus to 
make the correct response move lirely while 
the student is learning. It may be pictorial 
or verbal* It may vary in strength, l.e*, 
provide a model of the response which the 
student copies (e,g, , ^'Watch me and then do 
the same.") or provide a cue or hint of a 
weaker sort (e.g., "The opposite of black is 



See Accelerated Speech; Rate Expanded Speech. 

Recorded speech which, by one of a variety of 
techniques, has been slowed down without changing 
the pitch. Expanded speech has been used 
effectively with slow learners. See also 
Accelerated Speech. 



A procedure in 
behind a transl 
in front of the 
housed in a sel 
jectlon room, 
to the projecto 
the image from 
also called ind 



which a projector is located 
ucent screen, which is placed 
viewers. The projector may be 
f-contained unit or in a pro- 
Because a mirror system adapted 
r bends the beam and reverses 
left to right, the procedure is 
irect projection. 



The strengthening of the probability of recur- 
rence of a "response in a stimulus situation by 
following the response with a reinforcer. See 
also Extinction; Reinforcement, Negative; 
Reinforcement, Partial; Positive Reinforcement; 
Reinforcer; Reinforcement Schedules. 

Removal of an aversive stimulus, contingent 
upon a response (e.g., escape from an unpleasant 
situation by taking some action) resulting in 
the increase of the likelihood of future 
responses. * 

A pattern according to which only part of 
the responses are followed by reinforcement; 
e.g., when using a slot machine the user 
gets a payoff only part of the time. See 
also Reinforcement Schedules. 



Reinforcement, Positive 



Application of a positive (welcome) stimulus 
following a response to strengthen th6 proba- 
bility of the response's being made again. 



Reinforcement Schedules The contingencies on which reinforcement 

depends. For Interval Schedules > the first 
response at the end of a specified Interval 
, time Is reinforced, but none of the 

responses within the Interval, For Ratio 
Schedules > the first response at the end of 
a specified number of responses Is reinforced 
(e.g., each 40th response Is reinforced), For 
Variable Schedules > reinforcement varies 
about some mean Interval of time (variable 
Interval) or about some mean number of 
responses (variable ratio)* The simplest 
schedule Is Continuous Reinforcement In 
which a relnforcer Is given for every 
response, 

Relnforcer A class of events which, when 

response, strengthens the tendency for that 
response to occur. See also Extinction; 
Reinforcement, Negative; Positive Reinforcement 
Reinforcement , 

Resource In Instruction, any materials, agencies, 

activities, or persons that may be utilized 
to provide learning experiences or In the 
development of learning experiences* 

Response Generally, any activity which is induced by 

a stimulus. In instruction. It designates a 
wide variety of behavior which may involve 
a single word, selection among alternatives 
(multiple choice), the solution of a complex 
problem, or the non-yerbal manipulation of 
buttons, keys, etc. 

Response, Covert (Passive) An internalized response which the student 

presumably makes but which is neither 
recorded nor otherwise available to an 
observer (e.g,, a student thinks of a 
response) , 

The manner in which a student responds, e.g., 
writing a sentence, selecting an answer from 
a group of choices, repairing a piece of 
equipment, etc. 

A student's oral, written, or raanipulative 
act which is, or can be, recorded by an 
observer. 



Response Mode 



Response, Ove-r i 



Scrambled Book 



A form used to present an Intrinsically 
programmed text. In such a booki the student 
reads a portion of material and selects an 
answer to a multiple-choice question based on 
the material! The answer selected determines 
the page within the book to which the stuuent 
Is then directed for comment on the accuracy 
or Inaccuracy of his choice. Pages are shuffled 
or scrambled so that the student cannot detect 
right answer pages by their relative placement. 



Self-Instructional Program See Auto-lnstructlonal Program. 



Sequencing 



Shaping 



Simulation 



Simulator 



Single Concept Film 



Slide 



Arranging a series of frames, Items, or expe- 
riences directly related by subject or by under- 
lying thought. 

Reinforcement of successive approximations, 
starting with behavior that Is already present 
(e.g., questions the student can answer already). 
Gradual presentation of more difficult material 
demanding more sophisticated answers. 

A technique In which a real and complicated 
process Is represented by a simplified model 
that retains the appearance of reality but 
permits more "experimentation." 

Any machine or apparatus that represents a 
realistic condition or set of conditions, 
generally more nearly representative of the 
real world than trainers. See also Simulation. 

Usually a relatively short (less than 10 
minutes) film prepared for review or Instruc- 
tion pertinent to a single topic or Item of a 
course. For example, effective single concept 
films have been prepared to depict the visual 
and auditory cues relevant to aircraft spins. 

A mounted transparency either x 2'^ or 2-1/4'' 
X 2-1/4'' and designed for use with a slide 
projec tor. 



Slide Projector Projection Instrument designed to accept 2" x 

2" or 2-1/4" X 2-1/4" mounted transparencies. 
Slides may be advanced individually or in a 
cartridge through manual or remote controls* 

Software The technical data, programs, and language com- 

ponents of an educational system, as opposed to 
the hardware components. The computer and 
terminal are the hardware, the computer program 
is the software* 



Sound/Slide A series of slides with a short prerecorded 

audio presentation for each picture. The 
slides can be manually advanced or automatic- 
ally advanced by a signal (usually an audible 
or Inaudible tone on the sound portion) which 
Is recorded during preparation of the presen- 
tation. 



Speech, Acceleration 

Speech > Compression 

Speech) Rate Expansion 

Statement of Learning 
Objective (SOLO) 

Step 



See Accelerated Speech* 
See Accelerated Speech. 
See Rate Expanded Speech. 
See Behavioral Objective* 



A portion of 
a response* 
process that 
mastery. A 
into frames ) 
assumed that 
in a given s 
step and tha 
step forward 



material to which the student makes 
It is a stage in the instructional 
represents progresiS in the student *d 
subject to be taught is broken down 
items I or segrjents (steps)* It is 
students cannot take later steps 
equence before taking the earlier 
t each segment or item represents a 
See also Step size; Frame* 



Step size 



An Indefinltej intuitive basic concept in 
programmed instruction. The size of a step is 
not necessarily related to the size of a re- 
spjnse— a lengthy response may represent only 
a small step forward — nor is it necessarily 
related to the amount of material contained in 
a step. If students cannot respond to an Itenii 
that item is considered *'too large a step*" 
Generally an Increase in the number of items 
tends to reduce the size of the steps. See, 
also Step; Frame. 



Stimulus 



Stimulus Mode 



Any sensation, significant in that it elicits 
or controls an activity. In instruction, the 
input which elicits a response. 

The manner in which the stimulus relevant to 
chaining is perceived through the senses (i*e*> 
visual, auditory, tactile, anesthetic, olfactory, 
taste^ or any combination of senses such as 
audiovisual) . 



Subsystem 



A major functional subassembly or grouping of 
items or equipment which is essential to the 
operational completeness of a system* 



System (Instructional) 



System (in general) 



Systems Approach to 
Training 



Systems Design (in 
education) 



Target Population 



Task 



An integrated I programmed complex of instruc- 
tional media, machinery , and personnel whose 
components are structured as a single unit with 
a schedule of time and sequential phasing. Its 
purpose is to insure that all required compo- 
nents will be available with the proper char- 
acteristics at the proper time to contribute to 
the total instructional process and in so doing 
to fulfill the goals which have been established. 

The composite of equipment, skills, techniques 
(includes all related facilities, equipment, 
materials, services, and personnel) that is 
capable of performing and/or supporting an 
operational role. Systems are characterized by 
a defined purpose (function, mission or objective) 
which has been carefully analyzed and by identi- 
fiable inputs and coordinated processes yielding 
desired outputs. 

Depends on educational objectives clearly stated 
before Instruction begins, a description and 
analysis of the tasks necessary for achieving 
the stated objectives, evaluation procedures to 
determine whether or not the objectives have 
been reached, and methods for revising the pro- 
cess based on empirical data. Emphasis is on 
what has been learned (results achieved) rather 
than in resources and processes. This term means 
the same thing as Instructional System Develop- 
ment (ISD). 

Provides a conceptual framework for planning, 
orderly consideration of functions and resources 
including personnel and technical facilities, 
the kinds and amount of resources needed, and a 
phased and ordered sequence of events leading to 
the accomplishment of specified and operationally 
defined achievements. Should provide continuous 
feedback on the relation of performance of all 
components to factors of economy and should 
reveal any inadequacies of the several components 
and, consequently, of the entire system. 

The persons to: whom the instructional or train- 
ing materials are designed. Samples from this 
population are used in evaluating programmed 
materials during their development* 

A unit of work activity or operation that con*^ 
stitutes a logical and necessary step in a per-^ 
formance. 



Task Analysis 



Task Description 



Teaching Machine 



Teaching Step 



Technical Training 



An analytic technique to help the Instructional 
technologist design the learning materials. 
The technique Involves: (1) Identification of 
the component behaviors (inputs/actlons/outputs) 
which when chained together make up a criterion 
behavior, and (2) identification of the discreet 
bit of behavior which constitutes the criterion 
behavior. Intended to identify inputs to be 
discriminated or generalized, the input/action 
associations which must be made and the sequence 
in which inputs, actions, and outputs are 
chained together, 

A written description, usually in outline, which 
describes the terminal behavior at the highest 
level of generality. The description is intended 
to provide an overview of the total performance 
including normal activities and contingencies. 

A device that presents a program* The machine 
usually controls the material to which the 
student has access, contains a response mecha- 
nism, contains provision for knowledge of results, 
and may score and tabulate results. See also 
Computer-Assisted Instruction. 

Sometimes referred to as enabling objectives, 
they are the means whereby students obtain the 
skills and knowledges required for the success^ 
ful accomplishment of a criterion objective. 
See also Criterion Objective. 

One of four major responsibilities of the Air 
Training Command (ATC). Includes over 500 
separate technical courses taught at five ATC 
Technical Centers. 



Terminal Behavior 



The behavior the student Is expected to have 
acquired at the end of a course of Instruction. 
Evidence that such behavior has been acquired 
is provided by successful responses to Terminal 
Behavior Items or criterion tests. See also 
Criterion Test. 



Terminal Behavior Frame 



Threshold Knowledge Test 
(TKT) 



Item(s) at the end of instruction that contain 
no prompts. Intended to give evidence that 
terminal behavior has been acquired. 

The TKT is used prior to the development of an 
instructional system. It is administered to a 
sample of prospective students to determine 
what skills and knowledges should be put into 
the course of Instruction. 



Trainer 



Transfer of Training 



Transparencies 



Validation 



Visual Materials 



Whole-task Practice 



A performance-oriented device designed to 
simulate conditions inherent in the equipment 
which it represents. See also Simulator, 

The degree to which materials learned in the 
instructional situation, extend, generalize 
or apply to the job situation. 

Transparent materials designed for projection 
to facilitate enlargement of the image. 
Originally associated with 2" x V and 3-1/A" 
X A" slides, the term is now more popularly 
associated with 7'' x 7'' and 10" x 10" slides 
used with overhead projectors. 

For each step of instructional system develop- 
ment the checking of student performance by 
careful sampling from the potential student 
population and tryout of materials to Insure 
performance criteria are saticfied. The system 
is developed unit by unit and tested (or vali- 
dated) on the basis of the criterion objectives 
prepared for each unit. 

Those instructional materials which comiliunlcate 
primarily through sight, e,g,, projected pic- 
tures, charts, maps> 

See Practice, Whole^task, 
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